lychee - Writing a link checker in a weekend (plus two short years)

Experience the quirky journey of building lychee, an async Rust link checker. From weekend project to a 2-year saga, it explores software development's underestimated complexities, open-source struggles, and funding nuances. Dive into the reality of creating robust tools. How hard could it be?

Place
Geek
Length
60 min
When
November 20th, 2023
17:00

Abstract

Many developers entertain the notion that they could write a 'curl' clone in a
weekend. After all, *how hard could it be* to send a network request
and print the result?
In reality, they vastly oversimplify the intricacies involved.
My command-line tool lychee, an async Rust link checker, initially anticipated
as a weekend venture, has now extended into two years and still counting.
This journey unveils the deceptive complexity of what appears to be
a rudimentary task on the surface.

Throughout the developmental process, I encountered a plethora of challenges
that added layers of complexity. Some of these included handling rate limiting,
navigating around incorrect status codes, mastering the art of URL parsing,
dealing with timeouts, and grappling with client-side rendering using
JavaScript. We will go through each of these challenges step by step, and
explore the Weirdness of the Web.

Furthermore, we delve into the essential skills required in the development
process, exploring the often-overlooked aspects of funding open-source projects
and the relentless world of open-source maintenance. These insights shine a
light on the harsh realities and the hidden rewards of this crucial part of
software development.
The rabbit hole goes deep. How deep, you ask?
Join the talk to find out.

Stay connected

You can subscribe to our newsletter to stay updated on the latest news and announcements. Follow us on social media to join our community and engage with other attendees, speakers, and staff. We're on Twitter, Mastodon, Youtube and Facebook. Don't forget to use our official hashtag #RustLab2023 to share your experience and connect with other attendees on social media.

Subscribe to our newsletter

We hate spam just as much as you do, which is why we promise to only send you relevant communications. We respect your privacy and will never share your information with third parties.
©2023 RustLab | The international conference on Rust in Florence-Design & devCantiere Creativo-Made withDatoCMS