It's with sad hearts that we are announcing that search.cpan.org will be retired on the 25th of June 2018.
Graham Barr originally wrote the site nearly 20 years ago -- it first went live in early 1999 -- and it quickly became an invaluable resource for Perl developers around the world.
The ability to search CPAN (Comprehensive Perl Archive Network) and read Perl module documentation online helped spark many developers interest in Perl and helped to build the Perl community.
The site was originally hosted by Washington University in St. Louis on a single Solaris box. For his work on search.cpan.org, Graham won a White Camel award in 2002.
The site was later moved to the Perl NOC. US mirrors were hosted by YellowBot and Phyber and a European mirror has been hosted by digital craftsmen for the last 10 years. These amazing people and companies helped make the site a success.
In recent years maintenance has become a burden. Most of the site is running 2005 era Perl code. Luckily, there is now a viable alternative: MetaCPAN.org. The MetaCPAN team has been getting ready for the transition and is nearly ready to take over.
Shortly, a link will be added to all pages on search.cpan.org to inform users of the upcoming change. After about a month, all traffic will be redirected to the equivalent MetaCPAN page.
We would like to thank all who have assisted with this project. An extra special thanks to Graham for his hard work and unwavering support of search.cpan.org for all these years. To search.cpan.org -- we will miss you.
Update #1 (2018-05-19): There's some confusion around whether or not existing search.cpan.org URLs will continue to work. They will! The vast majority of of them will be transparently served by MetaCPAN pages. You do not need to update any links right now.
Thanks to Graham for starting such a useful community resource and to everyone else who has been involved in running it over the years.
ReplyDeleteIt's hard to recall a time before the existence of CPAN search - it's now such a vital part of the Perl ecosystem.
I hope there will be a redirect from search to metacpan. I still think of search as canonical.
ReplyDeleteThanks, Graham.
Yeah, it's good that metacpan.org has features in place to provide replacements for all search.cpan.org URLs, like this post says.
DeleteIt still seems like a huge shame that use.perl.org disappeared without providing any kind of continuity for its links. I wonder what happened there!
From the post:
Delete"After about a month, all traffic will be redirected to the equivalent MetaCPAN page."
I assume it'll be a 301 so Google will eventually update all of the entries in their index.
I echo Dave Cross's gratitude to Graham Barr and the Perl NOC for search.cpan.org.
ReplyDeleteI am sad that it is going away. I've always preferred it to metacpan.org.
An important question: What provision will be made for other internet resources which use search.cpan.org as their canonical cpan-search tool?
I speak of FreeBSD ports in particular. Each FreeBSD port has a 'pkg-descr' file which, if it's a port of a CPAN distribution, has a line like this:
#####
WWW: http://search.cpan.org/dist/CPAN-Testers-Common-Client/
#####
There are thousands of such ports. What will the update plan for that be?
Thank you very much.
Jim Keenan
Yes. Hopefully the redirects will take those URLs and redirect them intelligently.
DeleteThe post says that auotmatic redirections will be put in place.
DeleteBut this does raise an interesting issue. We should get in touch with all the groups who package CPAN modules in that way and ask them to update their packages.
I'll raise the issue on the FreeBSD ports mailing list. We may be able to bulk-find-replace all of them.
DeleteFreeBSD fixed this for all Perl ports a couple days ago.
Deletehttps://svnweb.freebsd.org/ports?view=revision&revision=470993
That's a shame. I prefer the clean interface of search.cpan.org over the metacpan site.
ReplyDeleteWhere's the source code? May be kinda fun to play around with.
https://github.com/metacpan/metacpan-web for the interface, https://github.com/metacpan/metacpan-api for the search/index backend
DeleteIf you meant the source code of cpansearch, it has never been published.
DeleteNever been published? So nobody can help with maintenance? Why?
Delete@unknown i don’t know Graham’s reasoning, but in my experience your question says that you vastly overestimate the chance people actually help and underestimate the effort it is to receive help (half baked patches, dealing with other people’s bugs). The cpan.org site is on GitHub and has years old bugs that nobody is helping with.
DeleteIt should be noted that not everything published on the Internet is always in a state that you can publish the source code...
DeleteGabor Szabo made a MetaCPAN-SCO project on Github. It was an open source search.cpan.org clone that uses the MetaCPAN API as a back-end.
https://github.com/szabgab/MetaCPAN-SCO
@unknown, there's an old term in Perl, the 'milliBarr' which applies to Graham's particular style. I patched it a number of times, but there was one problem I couldn't quite put my finger on so, I asked JHI, then the P5 Pumpking, to have a look and even he was bewildered. I wonder if his #WTF comment is still in there. :)
Delete@Ask Bjørn Hansen, at https://github.com/perlorg/cpanorg there are no issues. Where can I find the "years old bugs"?
Delete@Unknown - I added an issue at https://github.com/perlorg/cpanorg/issues/38 -- the original report was in various places I guess, ugh. Thank you.
DeleteThe links should all keep working. The MetaCPAN folks will consider it a bug if they don’t (I think there are a few exceptions for things that don’t have an equivalent page on metacpan).
ReplyDeleteCorrect, almost all existing URLs are supported (including the s.c.o api) there are a few metacpan does not have an equivalent for (browsing authors alphabetically for example) but we didn't feel were going to be missed.
ReplyDeletehttps://github.com/metacpan/sco-redirect is the redirection code.
I find the current wording on http://search.cpan.org a bit harsh and reminiscent of "Perl is dead" - esp. if people do not click through to the NOC posting.
ReplyDeleteMaybe somebody can change it to something like (taken from the NOC announcement):
--- START ---
It's with sad hearts that we are announcing that search.cpan.org will be retired on the 25th of June 2018.
Luckily, there is now a viable alternative: MetaCPAN.org. The MetaCPAN team has been getting ready for the transition and is nearly ready to take over.
Shortly, a link will be added to all pages on search.cpan.org to inform users of the upcoming change. After about a month, all traffic will be redirected to the equivalent MetaCPAN page.
We would like to thank all who have assisted with this project. An extra special thanks to Graham for his hard work and unwavering support of search.cpan.org for all these years. To search.cpan.org -- we will miss you.
--- END ---
See also
https://twitter.com/domm_favors_irc/status/997372975946100736
Greetings,
domm
PS: And of course a lot of thanks to all people involved in setting up / running search.cpan.org!!
Would be nice if a redirect was not required, i.e. make search.cpan.org a CNAME, or a mirror, of metacpan.org, also preventing having to have search.cpan.org be a machine just for emitting 301s.
ReplyDeleteWould also be nice if the remaining missing modules/missing files/missing pod issues could be resolved before search.cpan.org is shuttered.
This is a shame. Personally I find search.cpan.org much easier to navigate and understand. Still, I guess if there's no struggle there's no progress.
ReplyDeleteFork it.
Deletesearch.perl.org is incredibly helpful to make Perl powerful. It is only recently that metacpan has shown up as a viable alternative. And while I have a slight preference for the presentation on search.perl.org when I want to read module docs (no space wasted for a left column), I understand that maintaining two overlapping tools isn't what you want to do for a long time, and also the metadata on metacpan often are very useful.
ReplyDeleteBut as others have said: I really hope that the name "search.cpan.org" will remain forever, even if the implementation will be done with metacpan code. It is one of the best trademarks Perl ever had.
Thanks, Graham and all!
ReplyDeleteEnd of an era, indeed.
ReplyDeleteStill, I bristle at being left off of that as you have no idea the epic amount of time spent propping that site up for years at WU. Also, Ben Hockenhull hosted another system at Webster U. just down the street. Alan Burlison got Sun to donate the hardware, too.
Every time I search for "perl MODULE::NAME" search.cpan.org come up first. I would say 80% of the documentation I find goes to search*. Are these SEO seedings going to be broken after the move, or are there going to be redirect mappings to ensure the rankings stay relevant?
ReplyDeleteCPAN's web interface was an incredible feature and way ahead of its time. Other communities were still pointing people to FTP servers when CPAN had a full-featured search interface with fancy online documentation.
ReplyDeleteI got a chance to work on the code back in the day - I added the grep and diff features and a few other things, I think.
Good night, sweet prince!
Sam Tregar
Nooooooo! :-O
ReplyDeleteI likewise appreciate the work that search.cpan represents. As others, I have always preferred it to the metacpan site as a much cleaner interface.
I'll have to change my Perl course too to reflect the change I guess. Hmmmm.
Thank you for many years of helpful package management resources! Saying 2005 era perl code is out of date makes me feel super old! I think that's the first year I started learning pearl. MUCH LOVE! AND RESPECT!
ReplyDeleteThis headline may cause some readers (e.g. who see it via Hacker News) to believe that a pillar of Perl is being taken down as part of a perceived decline in Perl ... I wish it could be rewritten as "Perl Community Upgrades Interface to Modules; search.cpan.org Replaced by metacpan.org"
ReplyDeleteI have learned and benefitted so much from cpan.org over the years that I really cannot thank all of those who've contributed enough.
ReplyDeleteIt's going to be awhile before I learn to not type "cpan.org" into my address bar.
cpan.org is not related to search.cpan.org. cpan.org is still the front page of CPAN and will continue to provide links to metacpan as it already has been.
DeleteReally appreciated using search.cpan.org over the years - I'm going to miss it!
ReplyDeleteThanks for everyone who contributed to coding it and keeping it going.
As a relative newcomer to perl, but having been a system admin for over 10 years, I've always felt search.cpan.org was a bit clunky, and I generally prefer to use metacpan because of its familiar Wikipedia-like interface.
ReplyDeleteHowever, I appreciate the value search provides and I understand that the pros who have been using it for forever will find it hard to adjust.
I am a bit shocked to find out that the code was never open sourced, given this is an open source community, and I am really surprised there's not more of a clamor from the aforementioned old pros to open source it now so that some dedicated fan could fork it.
Given that it doesn't seem likely that will happen, could you at least work with the internet archive project to make a completecomplet rendering of the site before the transition, so we can still access it via the wayback machine? I know something similar was done for other sites (geocities anyone?)
I'd like to be able to show my kids the site in 15 or 20 years when they are (hopefully) doing coding for a living themselves.
If Perl wasn't in decline before now, it certainly will be with the nightmarish interface of metacpan.org.
ReplyDeleteWhen will the rest of cpan.org be taken down?
I think your handle says it all.
DeleteReally need to advertise this as 'New great updates coming to CPAN!' instead of the "eras are ending" stuff.
ReplyDeleteHats off, many thanks for being a reference for at least two generations of Perl developers.
ReplyDeleteOne *million* thanks, Graham! And thanks to the NOC team for supporting the "maze of twisty little passages" that is the Perl infrastructure while almost never getting eaten by a Wumpus!
ReplyDeleteMy thanks to everyone involved in both CPAN and MetaCPAN. Y'all done good. The world would be a much poorer place without all of the hard work you folks have put in, and I, for one, would be a lot dumber.
ReplyDeleteThere seem to be files served under the http://cpansearch.perl.org/ hostname as well. e.g. http://cpansearch.perl.org/src/MOOLI/Algorithm-Nhash-0.002/lib/Algorithm/Nhash.pm will those be redirected as well?
ReplyDeleteKudos to all involved in this wonderful resource.
ReplyDeletePerl might be deprecated in the eyes of so many, but I will always be proud of the Community it created, and grateful for having been a part of it.
chahn