The definition if a web crawler from Wikipedia is: A Web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web and that is typically operated by search engines for the purpose of Web indexing (web spidering). Which Serverless framework? When designing …
Continue reading Building a Serverless Web-crawler (AWS SAM)
In 2020 FarmHedge signed two customers that needed a new app and dashboard to trade and communicate with their own customers. Their requirements were quite similar at the core. Also, we needed to migrate our existing customers to a newer, more powerful version of the system. Their core requirements also matched the ones of the …
In this post, I collected a few articles that help understand how classic web-based systems became scalable, as well as an overview of general techniques that can make the difference between a system that support 100 active users and one that supports 1 million active users. Interesting articles A couple of interesting articles describing how …
This is a selection of books I found very useful to help me sharpen my technical and soft skills. They are also great for learning about engineering career paths. The Phoenix Project A Novel about IT, DevOps, and Helping Your Business. The Manager's Path A Guide for Tech Leaders Navigating Growth and Change. The Unicorn …
At FarmHedge we recently got to the point where the data we store has become an important asset for us and our customers. Our users ask us reports on their transactions on our system or statistics about their customers that are only stored on our databases. In the past we struggled to provide this type …
Bernardino Frola 