lychee - Writing a link checker in a weekend (plus two short years)

Experience the quirky journey of building lychee, an async Rust link checker. From weekend project to a 2-year saga, it explores software development's underestimated complexities, open-source struggles, and funding nuances. Dive into the reality of creating robust tools. How hard could it be?

Abstract

Many developers entertain the notion that they could write a 'curl' clone in a
weekend. After all, *how hard could it be* to send a network request
and print the result?
In reality, they vastly oversimplify the intricacies involved.
My command-line tool lychee, an async Rust link checker, initially anticipated
as a weekend venture, has now extended into two years and still counting.
This journey unveils the deceptive complexity of what appears to be
a rudimentary task on the surface.

Throughout the developmental process, I encountered a plethora of challenges
that added layers of complexity. Some of these included handling rate limiting,
navigating around incorrect status codes, mastering the art of URL parsing,
dealing with timeouts, and grappling with client-side rendering using
JavaScript. We will go through each of these challenges step by step, and
explore the Weirdness of the Web.

Furthermore, we delve into the essential skills required in the development
process, exploring the often-overlooked aspects of funding open-source projects
and the relentless world of open-source maintenance. These insights shine a
light on the harsh realities and the hidden rewards of this crucial part of
software development.
The rabbit hole goes deep. How deep, you ask?
Join the talk to find out.

Video

RustLab is a conference made by Develer.
Develer is a company based in Campi Bisenzio, near Florence. Our motto is : "Technology to give life to your products". We produce hardware and software to create exceptional products and to improve industrial processes and people's well being.
In Develer we have passion for the new technologies and we offer our clients effective solutions that are also efficient, simple and safe for the end users. We also believe in a friendly and welcoming environment where anybody can give their contribution. This passion and this vision are what we've been driven to organize our conference "made by developers for developers".

Subscribe to our newsletter

We hate spam just as much as you do, which is why we promise to only send you relevant communications. We respect your privacy and will never share your information with third parties.
©2024 RustLab | The international conference on Rust in Florence-Design & devCantiere Creativo-Made withDatoCMS