Breaking the Web…?

Alex posted an interesting discussion thread on the Weblogs Work blog – Breaking the Web?

There’s a school of thought that once something goes up on the Web, it should never be taken down. The theory holds that once you put something online, it’s forever indexed, linked, and permanent. Removing content breaks those links, thus "breaking the web".

Alex asks (in reference to a blog project that has come to an end):

What do we do?  Are we obligated to keep it up and running forever even though Mystic Tan is not going to pay us for continued management and hosting?  There are hundreds of links into the site, by taking it down we effectively break the web according to Adaptive Path, Mike Arrington and David Parmet (guys I really respect).

So what do you think? What’s the right thing to do here? We have our own opinions, but we’re not sure what the "right" answer is, so we’re open to opinion.