The definition if a web crawler from Wikipedia is: A Web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web and that is typically operated by search engines for the purpose of Web indexing (web spidering). Which Serverless framework? When designing …
Continue reading Building a Serverless Web-crawler (AWS SAM)
In 2020 FarmHedge signed two customers that needed a new app and dashboard to trade and communicate with their own customers. Their requirements were quite similar at the core. Also, we needed to migrate our existing customers to a newer, more powerful version of the system. Their core requirements also matched the ones of the …
I found particularly interesting the section "Productivity in the age of hypergrowth" and its subsection "More engineers, more problems" of the book An Elegant Puzzle by Will Larson [1]. These sections describe the amount of theoretical productivity of a three engineers team that is experiencing hypergrowth. It is assumed that one trained engineer spends about …
In this post, I collected a few articles that help understand how classic web-based systems became scalable, as well as an overview of general techniques that can make the difference between a system that support 100 active users and one that supports 1 million active users. Interesting articles A couple of interesting articles describing how …
This is a selection of books I found very useful to help me sharpen my technical and soft skills. They are also great for learning about engineering career paths. The Phoenix Project A Novel about IT, DevOps, and Helping Your Business. The Manager's Path A Guide for Tech Leaders Navigating Growth and Change. The Unicorn …
At FarmHedge we recently got to the point where the data we store has become an important asset for us and our customers. Our users ask us reports on their transactions on our system or statistics about their customers that are only stored on our databases. In the past we struggled to provide this type …
Talk about your problems. If nobody knows about them, nobody will be able to help you. Talk about your experience , your skills. Talk about your ideas, they will need someone else's brain to develop, and your brain will need someone else's ideas to flourish. Connect, network, socialize. A missed connection is a missed opportunity, …
At the airport, few things can go wrong. This is what I do to make travelling occupy a bit less space of my mind. Gather my stuff A few days before the trip, I designate an area where to place small items that I'll need during my vacation or business trip. This is very useful for items that …
I am going to remember that window forever. The house was OK, the room was nice, but that window was something more. When the sky was blue, I used to spend hours looking at it and through it. It made me deeply feel the greatness and the beautifulness of life, humanity and nature, all in that small blue …
It did not take long to realise how bad this cheap lamp was for reading in bed: http://www.tesco.com/direct/tesco-lighting-chloe-ceramic-table-lamp-cream/231-7345.prd?skuId=231-7345 The incandescent tungsten filament in the 20 watt bulb irradiated, surprisingly, quite a lot of light, but the ceiling was enjoining that light much more than I was. I needed to pierce the shade of the lamp to shed some light …
Continue reading How HappyLamp was born (from the ashes of a 6£ Tesco lamp)
Bernardino Frola 