instead of storing links directly as sha1/digest allow them to be in by_digest/sha1/di/digest so the number of links will not grow that fast
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 3.2 Final//EN"> <html> <head><title>OpenBSD ports collection</title></head> <body> <h1>OpenBSD ports collection</h1> <h2>Description</h2> %%DESCR%% <h2>Sub directories</h2> <dl COMPACT> %%SUBDIR%% </dl> </body></html>