mic_none

Wikipedia:Link rot/URL change requests/Archives/2025/February Source: en.wikipedia.org/wiki/Wikipedia:Link_rot/URL_change_requests/Archives/2025/February


deseretnews.com

Almost all links here are mapped redirects to articles at deseret.com, but conversion seems to be intractable, so the links should be archived. The converted links are of the form www.deseret.com/year/month/day/<id>/title-of-article, where the <id> seems to be unrelated to anything in the old link. Example: link [1] in 2012 United States presidential election is a mapped redirect to [2].

5,446 pages. Helpful Raccoon (talk) 02:48, 6 October 2024 (UTC)

Enwiki

  • Checked 5,456 pages and edited 4,934 pages. Moved 741 links to a new URL. Of which 736 are ghost redirects. Resolved 19 soft-404s. Removed 1 {{dead link}}. Added 240 {{dead link}}. Switched 60 |url-status=dead to live. Switched 628 |url-status=live to dead. Added 6,336 archive URLs (5,748 Wayback). Changed 342 citation metadata.

IABot

  • Checked and updated

 Done -- GreenC 15:47, 8 November 2024 (UTC)

foxnews.com/section/year/

Fox News articles of the form foxnews.com/<section>/yyyy/mm/dd/.... are mapped redirects to articles of the form foxnews.com/<section>/title-of-article. Example: [3] in "Weird Al" Yankovic is a mapped redirect to [4] (note that the text at the end of the first URL differs from that of the second, with "adapting" apparently misspelled in the first). Conversion is usually tractable so long as the article title is known, as it is similar to the Chicago Tribune conversion.

7,259 pages. Helpful Raccoon (talk) 03:14, 6 October 2024 (UTC)

Looks like two types of conversions: a simple URL transform by removing the date; and the harder "Chicago method", of extracting the title from the citation. I guess the best way is try to simple method first and if not then the Chicago method; if those do not work then check for ghost redirects; and finally add an archive. -- GreenC 15:59, 8 November 2024 (UTC)
It's working, but took a while to code as this is the first time I've attempted sequencing all the methods at once. The "Chicago" method is still pretty custom, I need to integrate it as part of the boilerplate code as a standard feature. Also with all these methods it's slow, 7,000 pages will take a while. -- GreenC 19:58, 8 November 2024 (UTC)
I added two new concepts to the glossary: ruled mapped redirect, and inferred mapped redirect. In this case, the removal of the date from the URL is a 'ruled mapped redirect' ie. a hard-coded rule to transform the URL. The parsing of the title is an 'inferred mapped redirect' because it is inferring (guessing) what the new URL might be, and could generate multiple guesses into an 'inference table', from which the bot checks each guess, until it finds a match. The inferred mapped redirect code is now incorporated as a feature that can be enabled/disabled for each project. -- GreenC 06:26, 9 November 2024 (UTC)
Helpful Raccoon, thanks for finding and reporting Fox News, it was helpful on a couple levels. Fixing the links, improving the bot's general code for future domains, and helping to distinguish (or at least name) the concepts of 'ruled mapped redirects' and 'inferred mapped redirects'. -- GreenC 15:14, 10 November 2024 (UTC)

Enwiki

IABot DB

  • Checked and updated about 15,000 URLs which propagate to 300+ wikis

 Done -- GreenC 15:14, 10 November 2024 (UTC)

cnbc.com/id/number/title

Articles of the form cnbc.com/id/<eight digit id>/<article title> can be converted to live articles or redirects by simply removing everything after the 8-digit id. Example: https://www.cnbc.com/id/37207942/Could_Italy_Be_Better_Off_than_its_Peers in Italy can be converted to https://www.cnbc.com/id/37207942, which redirects to the live article https://www.cnbc.com/2010/05/18/could-italy-be-better-off-than-its-peers.html.

A different example: https://www.cnbc.com/id/47387334/Jim_Breyer_via_Accel_Partners from Facebook can be converted to https://www.cnbc.com/id/47387334, which is a live article.

1,644 pages. Helpful Raccoon (talk) 08:23, 6 October 2024 (UTC)

OK. Some redirect some do not. I'll test them all and migrate the ones that redirect. It increased the search size, since it's also including anything with only an ID number. -- GreenC 16:24, 10 November 2024 (UTC)

Enwiki

 Done -- GreenC 01:18, 11 November 2024 (UTC)

variety.com

5623 pages.

Links with parameters do not work. If parameters are removed, some links will become redirect links.

Cherry Cotton Candy (talk) 04:28, 8 October 2024 (UTC)

Enwiki

  • Checked 2,852 pages and edited 2,681 pages. Moved 4,468 links to a new URL: 4,468 ruled mapped redirects. Removed 24 {{dead link}}. Added 6 {{dead link}}. Switched 554 |url-status=dead to live. Switched 18 |url-status=live to dead. Added 106 archive URLs (53 Wayback). Changed 178 citation metadata.

IABot DB

  • Checked and updated about 14,000 links which propagate to 300+ wikis

 Done -- GreenC 15:59, 12 November 2024 (UTC)

community.seattletimes.nwsource.com

All of the "http://community.seattletimes.nwsource.com" links seem to be dead, but can be substituted with "https://archive.seattletimes.com" as seen in Special:Diff/1253654883

There are 2,943 articles that match this description: per this search result.

I tried this with several links and it seemed to work fine. I'm not sure how many failed the transfer, but testing a bunch and it being fine seems to me like a lot of them still exist.

Take for instance, the one provided in the Gulf War page: http://community.seattletimes.nwsource.com/archive/?date=19910912&slug=1305069

An archive does exist, and it shows what is shown with the url replacement: Archived old link vs Live updated link Chewsterchew (talk) 04:59, 27 October 2024 (UTC)

Enwiki

  • Checked 2,951 pages and edited 2,905 pages. Moved 4,195 links to a new URL: 3,954 ruled mapped redirects, Removed 5 {{dead link}}. Switched 287 |url-status=dead to live. Added 33 archive URLs (20 Wayback). Changed 255 citation metadata.

IABot DB

  • Checked and updated about 1,000 links

 Done -- GreenC 04:04, 13 November 2024 (UTC)

avclub.com/articles

Seems like a lot of their music reviews have dead links. How can we fix this? Cahlin29 (talk) 03:58, 30 October 2024 (UTC)

Is there an example? -- GreenC 04:30, 30 October 2024 (UTC)
The link on Drake's Take Care is dead: https://www.avclub.com/articles/drake-take-care,65046
Same with Mac & Devin Go to High School (soundtrack): https://www.avclub.com/articles/snoop-dogg-and-wiz-khalifa-mac-and-devin-go-to-hig,66410
Also with Curtis (50 Cent album): https://www.avclub.com/articles/50-cent-curtis,7557
I'm presuming a pattern. Cahlin29 (talk) 17:22, 30 October 2024 (UTC)
The Drake link was moved here. The number "1798170489" is the key. I was able to find it in a ghost redirect as seen here (the old URL redirects to the new URL). It will be a while, I need to get through everything else above first. Looks like about 4,600 pages. -- GreenC 17:55, 30 October 2024 (UTC)
No worries, take your time, I assume the Internet Archive outage delayed things. Cahlin29 (talk) 20:45, 30 October 2024 (UTC)

Enwiki

  • First pass: Checked 4,601 pages and edited 2,924 pages. Moved 3,133 links to a new URL: 3,133 ghost mapped redirects. Switched 120 |url-status=dead to live. Added 73 archive URLs (26 Wayback). Changed 770 citation metadata.
  • Second pass: Checked 2,607 pages and edited 1,751 pages. Moved 3,493 links to a new URL: 468 inferred CDX mapped redirects, 3,025 ghost mapped redirects, Added 9 {{dead link}}. Switched 32 |url-status=dead to live. Switched 115 |url-status=live to dead. Added 1,199 archive URLs (1,067 Wayback). Changed 213 citation metadata.
Analysis: created a new method for discovery: inferred CDX mapped redirects. Converted domain names *.xvclub.com to www.avclub.com. Improved ghost redirect detection

IABot DB

  • Updated about 11,000 links that propagate to 300+ wikis

 Done - GreenC 05:01, 15 November 2024 (UTC)

screenindia.com

This website mapped redirects to indianexpress.com but has no equivalent text. Therefore, this needs archives only. 810 articles. Some of them already have archives added, such as at Vakkalathu Narayanankutty.Thanks! MrLinkinPark333 (talk) 02:24, 8 November 2024 (UTC)

Technically soft 404 (vs. mapped redirect). Corollary concepts. Soft 404 redirects when it shouldn't. mapped redirect doesn't redirect when should. -- GreenC 05:19, 15 November 2024 (UTC)

Enwiki

  • Checked 823 pages and edited 340 pages. Added 184 {{dead link}}. Switched 23 |url-status=live to dead. Added 136 archive URLs (104 Wayback). Changed 88 citation metadata.

IABot DB

  • Checked and fixed about 400 links which propagate to 300+ wikis

 Done -- GreenC 16:33, 15 November 2024 (UTC)

time.com

Time.com has moved their links to new URLs. Unfortunately, they are not easy to convert. For example, this is now here for Paul McCartney.. Therefore, I request archives URLs instead ~20k articles. Some of them already have archives added. Thanks! MrLinkinPark333 (talk) 15:53, 9 November 2024 (UTC)

I processed time.com in July 2021. It was large, took three days to process. Added 25,000 archive URLs. You can read my strategy in the link. Do you still see a lot of broken links without archive URLs? -- GreenC 01:07, 11 November 2024 (UTC)
Of the first 500 in the above link, 194 don't show archives. If you could filter out the ones without archive URLs for time, it'll help a lot. MrLinkinPark333 (talk) 01:11, 11 November 2024 (UTC)
How are you checking for archives? 194 is about 40%. I just manually checked 50 pages, every one has an archive (need to open the page and search on the link, the search result page doesn't provide enough information to determine). Except 3 cases that have a live link. Of those 50, in no cases would the bot add an archive URL. I could do this, but it will take a while to process, and I'm not sure how much it will accomplish. BTW the Paul McCartney example link no longer exists in the article, but it does exist in two others. Both have archives. -- GreenC 19:36, 11 November 2024 (UTC)
I only checked the results page and not manually checked each individual article. Is it possible to adjust the search result link above to calculate how many articles don't have archives first for time? Then, we could decide what to do next. MrLinkinPark333 (talk) 19:43, 11 November 2024 (UTC)
There is no easy way for this search. But recall Wikipedia:Link_rot/URL_change_requests#ctv.ca, which was also previously done in 2021, and it found 133 more archives. Maybe it's worth trying again. I'll need to build a list of target articles by searching a dump file, since the online search tops out at 10,000 results. -- GreenC 05:06, 12 November 2024 (UTC)
If you believe this is easier, feel free to check all of them. Since this request is big, I don't mind if it gets done later after the smaller requests are done. MrLinkinPark333 (talk) 02:16, 13 November 2024 (UTC)
Extracting all the page names that contain time.com requires searching a dump file which can take 6-8 hours to complete. This is required when the number of results is > 10,000 because Cirrus search (eg. "insource:..") won't return more than 10k results, due to resource constraints on their search server. Cirrus can return how many results there are > 10k, but won't display the actual results beyond 10k. I'll need to do the same with deadline.com below which has 40k results. -- GreenC 19:46, 15 November 2024 (UTC)

Enwiki

Analysis: almost all 'ruled mapped redirects' are http -> https. Since 'ghost redirects' were not available in 2021, they were discovered this time. Most of the archive URLs were non-Time.com domains that had a {{dead link}} tag and repaired incidentally. It was able to convert many |work=time.com to |work=Time, because this feature did not exist in 2021.

 Done -- GreenC 02:19, 17 November 2024 (UTC)

Nice to see many fixes! MrLinkinPark333 (talk) 03:37, 17 November 2024 (UTC)

deadline.com

Deadline.com redirects to new URLs with numeric IDs at the end. Any punctuation marks are removed like at this link to go here for Robert Pattinson. Any links that already have an numeric ID at the end can be skipped. ~1300 articles. Thank you! MrLinkinPark333 (talk) 16:06, 9 November 2024 (UTC)

There are over 40,000 pages with deadline.com .. limit to www.deadline.com there are 4,780. This is what I am checking on "Pass 1". -- GreenC 17:16, 15 November 2024 (UTC)

Enwiki

  • Pass1: Checked 4,784 pages and edited 4,364 pages. Moved 6,575 links to a new URL: 6,575 ruled mapped redirects, Added 24 {{dead link}}. Switched 98 |url-status=dead to live. Switched 143 |url-status=live to dead. Added 442 archive URLs (401 Wayback). Changed 1,295 citation metadata.
  • Pass 2: Checked 39,245 pages and edited 5,808 pages. Moved 2,278 links to a new URL: 2,278 ruled mapped redirects, Added 95 {{dead link}}. Switched 32 |url-status=dead to live. Switched 1,119 |url-status=live to dead. Added 2,126 archive URLs (2,018 Wayback). Changed 2,399 citation metadata.

 Done -- GreenC 00:22, 18 November 2024 (UTC)

paleobiodb.org

Their former URLs paleodb.org and fossilworks.org have been taken over by The Ecological Register; a seemingly well-meaning site. The old URLs such as:

http://paleodb.org/cgi-bin/bridge.pl?a=checkTaxonInfo&taxon_no=34738
http://www.fossilworks.org/cgi-bin/bridge.pl?a=taxonInfo&taxon_no=64541

have now become:

https://paleobiodb.org/classic/checkTaxonInfo?taxon_no=34738
https://paleobiodb.org/classic/checkTaxonInfo?taxon_no=64541

Can you fix/redirect these, please?
Big Blue Cray(fish) Twins (talk) 12:20, 12 November 2024 (UTC)

paleodb.org

2,000 pages

Enwiki
  • Checked 2,000 pages and edited 1,990 pages. Moved 1,957 links to a new URL: 1,957 ruled mapped redirects, Removed 14 {{dead link}}. Added 9 {{dead link}}. Switched 71 |url-status=dead to live. Added 30 archive URLs (29 Wayback). Changed 22 citation metadata.
 Done -- GreenC 02:24, 19 November 2024 (UTC)

fossilworks.org

7,269 pages

Big Blue Cray(fish) Twins: From Midshipman fish, there are a lot like this but I couldn't find an equivalent at paleobiodb -- GreenC 05:34, 18 November 2024 (UTC)

Manually fixed that one. For some reason, they don't match the standard profile, but do still retain the same numbers:

http://www.fossilworks.org/cgi-bin/bridge.pl?a=collectionSearch&collection_no=135043

became

https://paleobiodb.org/classic/displayCollResults?collection_no=col:135043

and:

http://www.fossilworks.org/cgi-bin/bridge.pl?a=taxonInfo&taxon_no=361425

became

https://paleobiodb.org/classic/basicTaxonInfo?taxon_no=txn:361425

Thanks for your expert ministrations, but I am afraid I have given you/your bot thousands more!!
Big Blue Cray(fish) Twins (talk) 09:20, 18 November 2024 (UTC)
Thank you. Done in Pass 2. More varieties on the margins, if they exist:
displayStrata has most instances. -- GreenC 15:49, 18 November 2024 (UTC)
Looks like displayStrata is: http://www.fossilworks.org/cgi-bin/bridge.pl?action=displayStrata&geological_group=&formation=Bohio&group_formation_member=Bohio ==> https://paleobiodb.org/classic/displayStrata?geological_group=&formation=Bohio&group_formation_member=Bohio
I'll rerun a Pass 3 with this update -- GreenC 21:49, 18 November 2024 (UTC)
The References are: http://www.fossilworks.org/cgi-bin/bridge.pl?a=displayReference&reference_no=12130 ==> https://paleobiodb.org/classic/displayRefResults?reference_no=ref:12130
Big Blue Cray(fish) Twins (talk) 22:24, 18 November 2024 (UTC)
And collectionSearch may be: http://www.fossilworks.org/cgi-bin/bridge.pl?action=collectionSearch&geological_group=Bauru&formation=Mar%EDlia ==> https://paleobiodb.org/classic/displayCollResults?&geologicalgroup=Bauru&formation=Marília
BUT will need checking against other results to be sure due to Unicode clouding the issue on the example provided
Big Blue Cray(fish) Twins (talk) 23:34, 18 November 2024 (UTC)
Running Pass 4 with the new rules, and a larger set of articles. -- GreenC 03:25, 19 November 2024 (UTC)
Enwiki
* Pass 1: Checked 7,269 pages and edited 6,391 pages. Moved 3,089 links to a new URL: 3,089 ruled mapped redirects, Removed 17 {{dead link}}. Switched 678 |url-status=dead to live. Added 6 archive URLs (6 Wayback). Changed 186 citation metadata.
* Pass 2: Checked 590 pages and edited 525 pages. Moved 1,645 links to a new URL: 1,645 ruled mapped redirects, Removed 2 {{dead link}}. Added 4 {{dead link}}. Switched 5 |url-status=dead to live. Added 2 archive URLs (2 Wayback).
* Pass 3: Checked 590 pages and edited 67 pages. Moved 603 links to a new URL: 603 ruled mapped redirects
* Pass 4: Checked 914 pages and edited 423 pages. Moved 687 links to a new URL. Added 20 archive URLs (20 Wayback).

 Done -- GreenC 04:41, 19 November 2024 (UTC)

avclub.com

Dead sub-domains. Can be made live again by converting hostname to "www." .. the hostname might be: origin|games|music|film|news|aux|tv|mobile .. 4,732 pages -- GreenC 21:22, 13 November 2024 (UTC)

Enwiki

IABot DB

  • Checked and updated about 3,500 links that propagate to 300+ wikis

 Done -- GreenC 14:55, 19 November 2024 (UTC)

nztop40.co.nz

I'm reposting a request I made at WP:BOTREQ and was directed here.

Dead citations occur due to the the website changing the URL format. For example https://nztop40.co.nz/chart/albums?chart=3467 is now https://aotearoamusiccharts.co.nz/archive/albums/1991-08-09.
Case 1: 9,025 pages that are using these URLs found through search. Some may already be archived.
Case 2: 4,133 citations using {{cite certification|region=New Zealand}} and {{Certification Table Entry|region=New Zealand}}, categorized Category:Cite certification used for New Zealand with missing archive (0).

An ideal transition seems difficult as it would require the following steps:

  1. Find an archived version through the wayback machine, e.g., https://web.archive.org/web/20240713231341/https://nztop40.co.nz/chart/albums?chart=3467 for the above. For case 2 this requires inferring the URL first (https://nztop40.co.nz/chart/{{#switch:{{{type|}}}|album={{#if:{{{domestic|}}}|nzalbums|albums}}|compilation=compilations|single={{#if:{{{domestic|}}}|nzsingles|singles}}}}?chart={{{id|}}}))
  2. Harvest the date 11 August 1991 either from the rendered archived page or from the archived page source, <p id="p_calendar_heading">11 August 1991</p>
  3. For case 1, translate the URL accordingly to https://aotearoamusiccharts.co.nz/archive/albums/1991-08-11.
  4. For case 2, add |source=newchart and replace |id=1991-08-11.

Note that for case 1, the word after "/archive/" changed according to the following incomplete table. For case 2 this is handled by the template so no need to worry about it.

Old text New text
albums albums
singles singles
nzalbums aotearoa-albums
nzsingles aotearoa-singles
tereosingles te-reo-singles
hotsingles hot-singles
hotnzsingles hot-aotearoa-singles

If someone is willing to go through the above, at least for simple cases, I think it is the ideal solution, especially for case 2. Failing that, a simpler archiving procedure can be taken.

  • For case 1: add |archive-url= and |archive-date= per usual archiving procedure. Add |url-status=deviated. If no archive exists (which should be a minority), add {{dead link}}
  • For case 2: add |archive-url= and |archive-date= per usual archiving procedure as they are supported by the templates. Add |source=oldchart (even if no archive is found)

I will be happy to support any technical assistance. Muhandes (talk) 22:55, 14 November 2024 (UTC)

Muhandes, I don't see any major hurdles with your ideal solution. It's a lot of citations, worth doing. I'm working through requests on this page chronologically. Might get to here in a week or less. -- GreenC 00:51, 15 November 2024 (UTC)
@GreenC: I'm happy to hear that. In the meanwhile I added records to the table above which should make it complete, to the best of my knowledge. I also noticed some of the URLs (53 of them to be accurate) add an additional #all_records_extra to the URL, e.g., https://nztop40.co.nz/chart/albums?chart=4413#all_records_extra. I will have a look at them individually and perhaps, since it's only 53, do them manually. --Muhandes (talk) 08:18, 15 November 2024 (UTC)
The pages using #all_records_extra were are all referring to the Heatseeker charts which don't seem to be available on the new website. As such, they should be archived, not translated to the new format. --Muhandes (talk) 10:32, 15 November 2024 (UTC)
Case 1 and 2 are different code bases. I have a separate code file for working with external link templates. So I'll initially focus on case 1, then likely some of that code can be reused with case 2. -- GreenC 15:07, 19 November 2024 (UTC)
To document an additional variation, the "End of Year" charts, like this, which have new URLs like https://aotearoamusiccharts.co.nz/archive/annual-{newcode}/{e}-12-31, where {newcode} is in the HTML search on "<h1>Top Selling [name]" where [name] could be Singles, Albums, NZ Singles, NZ Albums, Compilations - then extrapolate from the chart above. The "{e}" is the year taken from <p id="p_calendar_heading">...</p> -- GreenC 21:11, 19 November 2024 (UTC)
Muhandes: I need help translating the "discover" code as here. I tried this but does not work. -- GreenC 21:48, 19 November 2024 (UTC)
@GreenC: the "discover" charts are the same Heatseeker charts as the #all_records_extra ones. As far as I can tell they are no longer available. The only way to handle it is to find an archive-url. Note that in these cases the oldest archive-url is the best. I have found several cases where a new archive exists but it does not include the chart itself. Muhandes (talk) 23:45, 19 November 2024 (UTC)
OK. It defaults to oldest. In the end there were only 3 cases. -- GreenC 00:44, 20 November 2024 (UTC)
Logs: Wikipedia:Link_rot/Cases/nztop40.co.nz. The templates from Case 2 will show up in the tracking category. If there is no archive URL available it won't be able to make the conversion, and likewise won't be able to add an archive URL. Some archive URLs are available, but are soft-404s, or the original URL was not a valid chart page, or the template is malformed. I'll provide a list of the templates that didn't convert, so you can scan for syntax errors; the process is still running. -- GreenC 16:17, 20 November 2024 (UTC)
@GreenC Thank you. I guess I have my next project, fixing those references manually. Muhandes (talk) 12:51, 21 November 2024 (UTC)
@GreenC Can you please check why it failed on 3:15 (Breathe) case 2? The URL is https://nztop40.co.nz/chart/singles?chart=5565 archive exists at https://web.archive.org/web/20230428222709/https://nztop40.co.nz/chart/singles?chart=5565 (it was the first on the log). Muhandes (talk) 14:56, 21 November 2024 (UTC)
The logs show network failure .. likely Wayback Machine time out (I check for timeouts and have retries but at some point it gives up). I just tried it again, worked first try. I'll rerun the cases that didn't convert. -- GreenC 20:24, 21 November 2024 (UTC)
For case 2: Re-ran the 305 pages in Category:Cite certification used for New Zealand with missing archive plus the pages with an |archive-url= - it fixed 220 templates in 200 pages. Example -- GreenC 22:02, 21 November 2024 (UTC)
For case 1: Re-ran the 249 pages in Wikipedia:Link_rot/Cases/nztop40.co.nz (first two lists combined) and had only 1 new result. This leads me to believe that while running case 2 originally, there were intermittent problems with the Wayback Machine, during that period. If you see anything else it missed let me know and I'll investigate. -- GreenC 22:20, 21 November 2024 (UTC)
@GreenC Thanks again. I'll have a look later on the remaining pages and see if there is anything left to do. Muhandes (talk) 08:06, 22 November 2024 (UTC)
@GreenC I'm sorry but, again, the first entry in the category is 6lack discography where there is an unexplained case 2 failure https://nztop40.co.nz/chart/singles?chart=4494 where https://web.archive.org/web/20180629074435/https://nztop40.co.nz/chart/singles?chart=4494 exists. I'd appreciate it if you can check it. --Muhandes (talk) 10:21, 22 November 2024 (UTC)
Problems found and fixed:
  1. '&' character in the template not percent encoded, which caused an API request to return incorrect results.
  2. Certain difficult citations: Grease (1978 soundtrack): {{Certification Table Entry|region=New Zealand|type=album|title=Grease Soundtrack|artist=Various|award=Platinum|number=6|id=5383|salesamount=250,000|certyear=2022|relyear=1978|access-date=21 August 2022|salesref=<ref>{{cite web|url=https://www.americanradiohistory.com/Archive-Billboard/70s/1979/Billboard%201979-03-17.pdf|title=Tax Clouds Growth And Dampens Local Talent Development|publisher=Billboard|page=SA-6|first=Phil|last=Gifford|date=17 March 1979|access-date=31 July 2019}}</ref>}}
Down to below 80. -- GreenC 00:11, 23 November 2024 (UTC)
Thanks again. Going through the remaining certifications is a pain-staking task but I'm going to do it. Can you please have a look at this edit? The url is https://nztop40.co.nz/chart/albums?chart=4736 and archive-url is https://web.archive.org/web/20190816231216/https://nztop40.co.nz/chart/albums?chart=4736 which shows date 19 August 2019. This should have been translated to |id=2019-08-19, but as you cans see, it didn't.
A second thing I just realized that case 2 also includes rare calls from {{Certification Cite Ref}} which is, sadly, still widely used (Category:Certification Cite Ref usages outside Certification Table Entry (1,299)), especially in discographies. For example, BTS albums discography, Eagles discography, Cobra Starship discography. Muhandes (talk) 09:57, 24 November 2024 (UTC)
  • Well, Wikipedia follows the 80/20 Rule. It's sort of like climbing Mt. Everest without oxygen. The first 80% is easy. The next 10% is hard. The last 10% is as hard as the previous 90% combined. This is why many people give up once it gets to 90% (or around there) without reaching 100%. The work gets exponentially difficult.
  • To answer your question about the date offset, I'm embarrassed to say there is a typo in the code, converting "August" to "09", instead of "08". The site then redirected the bogus date page to a working page nearby, September 13. So I never caught it. This is unfortunately the case for everything with an August month. There are about 840 citations in 750 pages that would possibly be a problem.. probably about half that since some are legitimate September dates. This will be tricky to fix. I keep logs with old -> new template data that make it possible, for this sort of regression situation.
  • 'Certification Cite Ref', if you can give me the template format it seems to use different parameters. -- GreenC 03:17, 25 November 2024 (UTC)
I'm a pefectionist. It may take me years but I aim to reach 100%.
{{Certification Cite Ref}} uses the same format as {{cite certification}} when it comes to |id= and |source=. Muhandes (talk) 08:05, 25 November 2024 (UTC)
Found and fixed the August error: 343 citations in 320 pages. Example. The edit counts in the edit summary are not always accurate due to the way it was done.
Ran the CCR template. It only edited 15 pages, but it got the three pages you mentioned, so I suspect it's probably accurate.
-- GreenC 19:53, 25 November 2024 (UTC)
I finished cleaning up the category. I may deal with the rest of the cases at a later date. Anyway, I believe the bot's work is done. Thank you! Muhandes (talk) 19:12, 3 December 2024 (UTC)
User:Muhandes: Congrats! Nice to see your dedication to reach 100%. This project required new bespoke code that of course had some bugs on the first/second try but you kept error checking it and narrowed the numbers down to something manageable so the rest could be done manually, which is admirable work. My boilerplate code is well tested, but novel situations like this are often how the boilerplace code gets new features added. Although I've never seen anything like this before, I'll keep it mind in case the pattern comes up again. -- GreenC 17:57, 10 December 2024 (UTC)

Enwiki

IABot DB

  • Checked and updated about 3,000 links which propagate to 300+ wikis

 Done (pending further edge cases above) -- GreenC 01:27, 22 November 2024 (UTC)

health.gov

Looks like the original site at health.gov was moved to https://odphp.health.gov and a new health.gov was created. Some links might need updating. --Nintendofan885T&Cs apply 19:39, 18 November 2024 (UTC)

There are 127 pages. Will convert to archive URLs, unless there is a working redirect. -- GreenC 05:20, 19 November 2024 (UTC)

Enwiki

  • Checked 127 pages and edited 92 pages. Moved 130 links to a new URL: 115 redirects, 15 ghost mapped redirects, Switched 6 |url-status=dead to live. Added 3 archive URLs (3 Wayback). Changed 28 citation metadata.

 Done -- GreenC 02:48, 22 November 2024 (UTC)

currentaffairs.org

The links to currentaffairs.org have been changed. They used to be just:
currentaffairs.org/yyyy/mm/article-name
But have now changed to:
currentaffairs.org/news/yyyy/mm/article-name
At the moment most of the links are being redirected from the old URLs to the new ones. -- LCU ActivelyDisinterested «@» °∆t° 18:43, 30 November 2024 (UTC)

125 pages -- GreenC 03:13, 1 December 2024 (UTC)

Enwiki

(and manually repaired 3 pages with typos in the URLs)

 Done -- GreenC 16:24, 16 December 2024 (UTC)

people.com

Hello. Old urls with only numeric IDs don't work, such as this link for Bruno Mars. I haven't seen replacement URLs on the website. Therefore, I request archives for these URLS, unless new links can be found. ~2500 pages. Some already have archive urls added. Thanks! MrLinkinPark333 (talk) 19:21, 6 December 2024 (UTC)

Enwiki

(The 624 represent URLs that were http:// converted to https:// (a ruled mapped redirect) and at the same time a normal redirect was found and followed and converted to a live link. Because so few archives were added it appears the domain was previously processed converting to archives, though not by WaybackMedic)

IABot DB

  • Updated about 6,000 URLs which propagate to 300+ wikis

MrLinkinPark333: other domains have a similar URL structure eg [5] in 2001 Marsh Harbour Cessna 402 crash .. probably the same Content Management System (CMS). -- GreenC 02:32, 17 December 2024 (UTC)

That one could be fixed with a similar URL that keeps the numeric ID. If you want to go through The Observer dead links, feel free to. MrLinkinPark333 (talk) 02:38, 17 December 2024 (UTC)
There are only about 240, probably worth doing, but I bet this pattern: name.com/string/string/0, can be found throughout. -- GreenC 17:52, 17 December 2024 (UTC)

While doing Sports Illustrated below, I found a recently introduced bug that would explain why so few archive URLs were added. I'll need to reprocess the enwiki of people.com -- GreenC 18:41, 17 December 2024 (UTC)

 Done -- GreenC 01:18, 18 December 2024 (UTC)

vault.sportsillustrated.cnn.com

These links might be able to convert to new links at si.com. The new URL format is vault.si.com/vault/year/month/day/name-of-article/ - For example: this link is now here for Kenny Anderson (basketball). However, it won't always work as this is now here for Guus Hiddink. As some new URLs also have the subtitle, I suggest trying to convert with the headline only first, then add the subtitle if that doesn't work. Otherwise, I request regular archives if converted URLs aren't found. ~800 articles. Thanks! MrLinkinPark333 (talk) 20:07, 6 December 2024 (UTC)

Enwiki

  • Checked 829 pages and edited 251 pages. Moved 254 links to a new URL: 254 inferred mapped redirects, Resolved 496 soft-404s. Removed 1 {{dead link}}. Added 5 {{dead link}}. Switched 195 |url-status=dead to live. Added 16 archive URLs (4 Wayback). Changed 40 citation metadata.

 Done -- GreenC 04:47, 19 December 2024 (UTC)

vault.si.com/vault/

I've also discovered that some of these links are broken. For example, this link doesn't work for Kraus–Weber test and there isn't a replacement URL. However, this is working for Dick Donovan. As this would conflict with the cnn.com ones above, I think these ones should be checked first. ~2,200. Thank you! MrLinkinPark333 (talk) 21:02, 6 December 2024 (UTC)

Enwiki

IABot DB

  • Updated 5 links

 Done -- GreenC 18:27, 18 December 2024 (UTC)

archive.fwweekly.com

Old to new form via inferred mapped redirect method to determine date and title. Example. 36 pages -- GreenC 18:58, 12 December 2024 (UTC)

Enwiki

 Done -- GreenC 03:41, 19 December 2024 (UTC)

observer.theguardian.com

These links are now redirecting to new URLs. this is now here for Andrew Lincoln Any new URLS without /observer/ need to be swapped to The Guardian. For example, this is now here for Tony Blair. However, some redirect to 404s like this one for The Stone Roses (album). 76 articles Thank you! MrLinkinPark333 (talk) 18:52, 19 December 2024 (UTC)

Enwiki

  • Checked 72 pages and edited 60 pages. Moved 62 links to a new URL: 62 ruled mapped redirects, Added 1 {{dead link}}. Switched 7 |url-status=dead to live. Added 3 archive URLs (0 Wayback). Changed 21 citation metadata.

 Done -- GreenC 03:33, 5 January 2025 (UTC)

domainname.theguardian.com

Most of the domain names for The Guardian redirect to new links. For example, this goes here for Art criticism. However not all of them work. Here's what I've found so far:

  • Broken: witness.theguardian.com, blogs.theguardian.com
  • Working redirects: film.theguardian.com, politics.theguardian.com, business.theguardian.com, arts.theguardian.com, careers.theguardian.com

There's probably more, but I'm not sure how to search for it. MrLinkinPark333 (talk) 19:29, 19 December 2024 (UTC)

It will likely be > 10k (Cyrus maxes at 10k). I can search a dump file for pages that contain *.theguardian, and the bot will internally skip www and <none> links. Also there are over 2000 pages with amp (mobile optimized) to be converted to www -- GreenC 03:03, 20 December 2024 (UTC)
If you want to do the mobile ones first, that might be easier. MrLinkinPark333 (talk) 03:09, 20 December 2024 (UTC)
OK. The original request will be redirects, and archived mapped redirects (ghost). The amp will be ruled mapped redirects. Maybe some ruled inferred mapped redirects are possible. Anyway I need to finish WP:JUDI batch #20 first, it's larger than all previous JUDI batch's combined, will require a bunch of runs due to size limits. -- GreenC 03:52, 20 December 2024 (UTC)
No worries! These requests can wait :) MrLinkinPark333 (talk) 19:58, 20 December 2024 (UTC)
Awaiting on Wikimedia's January dump. -- GreenC 18:57, 5 January 2025 (UTC)
More info -- GreenC 17:58, 7 January 2025 (UTC)
I thought of a different way to find them, is pretty simple and better. For example find all pages s.theguardian then repeat for each letter in the alphabet, skipping "w" (www) and "p" (amp). The end result is 104 articles. -- GreenC 15:18, 10 January 2025 (UTC)

Enwiki

 Done -- GreenC 03:36, 12 January 2025 (UTC)

247sports.com

2018 New York Giants season

  1. https://247sports.com/nfl/new-york-giants/Bolt/NFL-Free-Agency-Josh-Mauro-signs-with-New-York-Giants-116458092
  2. https://247sports.com/nfl/new-york-giants/Article/NFL-Free-Agency-Josh-Mauro-signs-with-New-York-Giants-116458092/

2018 Green Bay Packers season

  1. https://247sports.com/nfl/green-bay-packers/Bolt/Report-Packers-tender-OL-Adam-Pankey--116192054
  2. https://247sports.com/nfl/green-bay-packers/article/nfl-free-agency-packers-tender-offensive-lineman-adam-pankey--116192054/

Green Bay Packers

  1. https://247sports.com/nfl/green-bay-packers/Bolt/Green-Bay-Packers-to-wear-color-rush-uniforms-vs-Chicago-Bears--108117457/
  2. https://247sports.com/nfl/green-bay-packers/article/green-bay-packers-to-wear-color-rush-uniforms-vs-chicago-bears--108117457/

Ahmad Thomas

  1. https://247sports.com/nfl/green-bay-packers/Bolt/Green-Bay-Packers-sign-LB-Ahmad-Thomas-to-practice-squad--111380990/
  2. https://247sports.com/nfl/green-bay-packers/article/green-bay-packers-sign-lb-ahmad-thomas-to-practice-squad--111380990/

This was done in April but for some reason many did not work. -- GreenC 02:31, 23 December 2024 (UTC)

Tag: FABLE-1224

43 pages

-- GreenC 02:31, 23 December 2024 (UTC)

Enwiki

 Done -- GreenC 20:38, 5 January 2025 (UTC)

frank.mif.pg.gda.pl/sheets

http://www.frank.mif.pg.gda.pl/sheets/*

Defunct for some time. Was only a mirror to

https://frank.pocnet.net/sheets/*

which is alive and kicking. IAbot has already put in some unnecessary links to Wayback.

6 pages

— Preceding unsigned comment added by 2001:8A0:5E5D:D200:8CFD:3F84:7C2D:F066 (talk • contribs)

Enwiki

 Done -- GreenC 02:45, 7 January 2025 (UTC)

www.ukzn.ac.za

  1. https://www.ukzn.ac.za/ccs/default.asp?3,28,11,1385
  2. https://ccs.ukzn.ac.za/default.asp?3,28,11,1385

70 pages

Tag: FABLE-1224

-- GreenC 16:13, 23 December 2024 (UTC)

Enwiki

  • Checked 70 pages and edited 28 pages. Moved 14 links to a new URL: 14 ruled mapped redirects, Removed 3 {{dead link}}. Added 5 {{dead link}}. Switched 1 |url-status=dead to live. Added 10 archive URLs (7 Wayback).

 Done -- GreenC 21:41, 5 January 2025 (UTC)

ufc.com/fighter

  1. http://www.ufc.com/fighter/David-Mitchell
  2. https://www.ufc.com/athlete/david-mitchell

983 pages

Tag: FABLE-1224

-- GreenC 16:18, 23 December 2024 (UTC)

Enwiki

 Done -- GreenC 00:50, 6 January 2025 (UTC)

uctv.tv

  1. https://www.uctv.tv/search-details.asp?showID=5048
  2. https://www.uctv.tv/search-details.aspx?showID=5048

15 pages

Tag: FABLE-1224

-- GreenC 16:21, 23 December 2024 (UTC)

Enwiki

 Done -- GreenC 01:58, 6 January 2025 (UTC)

torontofc.ca

  1. http://www.torontofc.ca/news/2015/06/dwayne-de-rosario-calls-it-career
  2. http://www.torontofc.ca/news/dwayne-de-rosario-calls-it-career

186 pages

Tag: FABLE-1224

-- GreenC 16:32, 23 December 2024 (UTC)

Enwiki

  • Checked 186 pages and edited 177 pages. Moved 614 links to a new URL: 98 normal redirects, 516 ruled mapped redirects, Resolved 6 soft-404s. Removed 1 {{dead link}}. Added 3 {{dead link}}. Switched 201 |url-status=dead to live. Switched 9 |url-status=live to dead. Added 75 archive URLs (67 Wayback). Changed 52 citation metadata.

 Done -- GreenC 05:07, 6 January 2025 (UTC)

topspeed.com/cars

Normal redirects, but some of the redirects go to a 404 page:

  1. https://www.topspeed.com/cars/mercedes/2015-mercedes-cls63-amg-ar164010.html
  2. https://www.topspeed.com/cars/mercedes/2015-mercedes-cls63-amg/

564 pages

Tag: FABLE-1224

-- GreenC 16:45, 23 December 2024 (UTC)

Enwiki

  • Checked 561 pages and edited 470 pages. Moved 535 links to a new URL: 341 normal redirects, 194 ruled mapped redirects, Resolved 8 soft-404s. Removed 16 {{dead link}}. Added 20 {{dead link}}. Switched 3 |url-status=dead to live. Switched 1 |url-status=live to dead. Added 15 archive URLs (0 Wayback). Changed 196 citation metadata.

 Done -- GreenC 15:59, 6 January 2025 (UTC)

timbers.com

  1. http://www.timbers.com/t2/2015/06/usl-match-recap-seattle-sounders-2-2-portland-timbers-2-0
  2. https://www.timbers.com/news/usl-match-recap-seattle-sounders-2-2-portland-timbers-2-0

489 pages

Tag: FABLE-1224

-- GreenC 16:55, 23 December 2024 (UTC)

Enwiki

  • Checked 492 pages and edited 421 pages. Moved 711 links to a new URL: 416 normal redirects, 295 ruled mapped redirects, Removed 7 {{dead link}}. Added 15 {{dead link}}. Switched 15 |url-status=dead to live. Switched 55 |url-status=live to dead. Added 303 archive URLs (297 Wayback). Changed 465 citation metadata.

 Done -- GreenC 01:58, 7 January 2025 (UTC)

licensing.fcc.gov

This is to correspond to a system shutdown January 2, 2025 (context). The documents have all been mirrored by a third party. This requires regex to capture a one- to six-digit imported letter ID. Also include http:// versions of these URLs.

  1. https://licensing.fcc.gov/cgi-bin/prod/cdbs/forms/prod/getimportletter_exh.cgi\?import_letter_id=\d{1,6} or https://licensing.fcc.gov/cgi-bin/prod/cdbs/forms/prod/getimportletter_exh.cgi\?import_letter_id=\d{1,6}&.pdf
  2. https://cdbs.recnet.com/corres/?doc=$1

Sammi Brie (she/her • t • c) 17:36, 25 December 2024 (UTC)

2,729 pages. I'll run this soon ahead of the queue due to the imminent shutdown, so any missing archives might be archived. -- GreenC 18:44, 25 December 2024 (UTC)
I was unable to get to this before the deadline, but was able to convert all but 21, and not all of those are the same type of URL. -- GreenC 18:55, 5 January 2025 (UTC)
@GreenC Thank you. Is there a list of the 21 dead links? Sammi Brie (she/her • t • c) 19:01, 5 January 2025 (UTC)
Wikipedia:Link_rot/Cases/licensing.fcc.gov -- GreenC 19:12, 5 January 2025 (UTC)

Enwiki

IABot DB

  • Updated about 1,200 links which will propagate to 300+ wikis (note: conversions to archive URLs as mapped redirects are not supported by IABot at this time)

 Done -- GreenC 20:22, 5 January 2025 (UTC)

academie-goncourt.fr

Rediercts to academiegoncourt.com

95 pages -- GreenC 04:53, 2 January 2025 (UTC)

Enwiki

 Done -- GreenC 02:34, 7 January 2025 (UTC)

thenet.ng

Any links with /year/month/ can be removed to fix links from thenet.ng. For example, this is now here for Local Rappers. ~630 links. Thanks! MrLinkinPark333 (talk) 02:21, 10 January 2025 (UTC)

457 pages -- GreenC 15:33, 10 January 2025 (UTC)

Enwiki

  • Checked 462 pages and edited 440 pages. Moved 656 links to a new URL: 656 ruled mapped redirects, Resolved 10 soft-404s. Removed 1 {{dead link}}. Added 3 {{dead link}}. Switched 354 |url-status=dead to live. Switched 5 |url-status=live to dead. Added 36 archive URLs (31 Wayback). Changed 42 citation metadata.

 Done -- GreenC 04:42, 12 January 2025 (UTC)

kicker.de

All kicker.de links redirect to different kicker.ch links. Example: on Pep Guardiola [6] redirects to [7] and [8] to [9]. Nobody (talk) 12:49, 10 January 2025 (UTC)

6,793 pages -- GreenC 15:30, 10 January 2025 (UTC)

There are two parts of the redirect: the domain, and the path. The domain kicker.ch is Switzerland. When I open a link to kicker.de (I'm in the USA) it stays at kicker.de .. it appears the site is location-aware and redirects the domain based on your location, for some countries. The path also redirects, and that appears to be the same in .de or .ch .. I think the safe thing is keep kicker.de but change the path. -- GreenC 22:08, 12 January 2025 (UTC)

Sounds good. Nobody (talk) 06:05, 13 January 2025 (UTC)
This site has a complication, some links are "crunchy 404", a page that is partly correct and partly wrong. For example this is supposed to go to the 2009-10 season, but it redirects to the current season with drop down menus to find older seasons. In this situation changing the URL to the redirect results in a loss of information in the URL and citation. So what I have done is identify when URL redirects lose information, and leave the existing URL alone, neither change to the redirect URL, nor add an archive URL. When users click the link it will just follow the natural redirect. If the link or redirect ever stop working, the existing URL will inform them what they are trying to find and be able to repair it with a new link. -- GreenC 15:51, 13 January 2025 (UTC)
They probably removed older seasons and just redirected to the current one, as long as the current URL works or a archive link is available it shouldn't have an impact. Nobody (talk) 16:16, 13 January 2025 (UTC)

Enwiki

 Done -- GreenC 17:22, 13 January 2025 (UTC)

singapore-elections.com

Hello. A couple of months ago your bot tagged a load of links to singapore-elections.com as usurpsed and changed the link to a Web Archive one (e.g. here). The website has moved to sg-elections.com and otherwise the urls are unchanged. Is there a way to replace all the web archive links/usurped tags with the new urls? The site was quite widely used as a source. Cheers, Number 57 01:31, 12 January 2025 (UTC)

No problem, can unwind usurpations. 193 pages
  1. http://www.singapore-elections.com/general-election/1951/seletar.html (dead)
  2. https://sg-elections.com/general-election/1951/seletar.html (live)
  3. https://www.sg-elections.com/general-election/1951/seletar.html (live)
2 and 3 have identical headers, probably frontend magic. Will default to #2 because it's shorter. -- -- GreenC 04:58, 12 January 2025 (UTC)
User:Number 57: Some of the new URLs are not working because they changed the URL structure. From Png Eng Huat:
  1. https://singapore-elections.com/parl-2011-ge/east-coast-grc.html (original - broken)
  2. https://sg-elections.com/parl-2011-ge/east-coast-grc.html (automatic transform - broken)
  3. https://sg-elections.com/general-election/2011/east-coast-grc.html (manually discovered - works)
I'll need to program a rule "parl-YYYY-ge" --> "general-election/YYYY" .. there will be other rules. Can you help find more rules? The links still exist on about 70 pages. I completed 256 links below in Pass 1. -- GreenC 22:20, 13 January 2025 (UTC)
@GreenC: Ah, sorry about that. A few others:
  • Anything with /beXXXX/ becomes /by-election/XXXX/
  • Anything with /lega-XXXX-be/ becomes /by-election/XXXX/
  • Anything with /lega-XXXX-ge/ becomes /general-election/XXXX/
  • Anything with /candidates-X.html (where X is a lowercase letter) becomes /candidates/X.html
Urls starting http://www.singapore-elections.com/malaysia-political-parties/ do not appear to have been copied across to the new site... I've fixed a couple of other random ones. Cheers, Number 57 23:17, 13 January 2025 (UTC)
Pass 2 results below. The search shows 17 remain; but those are only cite web, I'm not sure how to search for the remaining {{usurped}}. It's probably similar. -- GreenC 01:20, 14 January 2025 (UTC)

Enwiki


 Done - closing but reopen if you find more to do. -- GreenC 16:35, 17 January 2025 (UTC)

nationmultimedia.com

The website of The Nation (Thailand), previously at nationmultimedia.com, was moved to the domain nationthailand.com in 2019. Most links are still under the same URL structure. --Paul_012 (talk) 21:27, 15 January 2025 (UTC)

1,400 pages -- GreenC 16:33, 17 January 2025 (UTC)

Enwiki

IABot DB

  • Updated about 3,500 links which propagate through 300+ wikis

 Done -- GreenC 06:10, 18 January 2025 (UTC)

whitehouse.gov

Like the 2021 request, old whitehouse.gov links need changing to https://bidenwhitehouse.archives.gov

Thanks --Nintendofan885T&Cs apply 18:21, 21 January 2025 (UTC)

OK. How long do they need to transition, or ready? -- GreenC 20:57, 21 January 2025 (UTC)
@GreenC: Any citation with the date parameter between January 21, 2021 and January 19, 2025 should be changed over (January 20 will have an overlap between administrations so probably should be done manually) --Nintendofan885T&Cs apply 10:48, 26 January 2025 (UTC)

3,797 pages -- GreenC 02:22, 27 January 2025 (UTC)

Observations

  1. Whitehouse.gov is not fully populated yet. For example there is nothing for [10] (Office of Management and Budget), the largest office in the Executive branch the federal budget (Re-homed to X.com ?)
  2. This is a dynamic site. For example there is a link from 2015 (Obama) that was deleted by Trump (2017) that was restored by Biden (2021) that was deleted by Trump (2025). The bot was able to follow and restore to the version at obamawhitehouse.archives.gov which should be permanent. Another link was active during Trump term 1, Biden kept it active, then Trump term 2 deleted it. The bot restored it to trumpwhitehouse.archives.gov (trump term 1).
  3. Links have multiple migration paths: Still works; redirect to a soft 404 at whitehouse.gov; a missing redirect to whitehouse.gov; redirect to a working page at archives.gov; redirect to a soft-404 at archives.gov; missing redirect to archives.gov; dead links needing an archive URL.
  4. There is some content drift, such as [11]
  5. Ironically the webmaster misspelled Kennedy assassination in the URL [12], then created a redirect to cover it up.
  6. The White House is blocking Internet Archive IPs (429 DDOS) at the moment.
  7. Needless to say, doing my best, under the circumstances. There are logs, if something looks messed up, I'll try to repair it.

Enwiki

 Done -- GreenC 05:20, 1 February 2025 (UTC)

Shouldn't this use archive-url parameter?

@GreenC: In the fix, the |url= parameter was changed, but isn't it better practice to leave |url= unchanged and use |archive-url= with |url-status=dead and |archive-date=2025-01-20? I already had it set this way at misinformation about the 2024 Atlantic hurricane season, but the fix undid my precise citation template usage. Dan Leonard (talk • contribs) 07:54, 1 February 2025 (UTC)

No, because they are not web archives. The |archive-url= is for web archives. The list of available web archive providers is Wikipedia:List of web archives on Wikipedia. The whitehouse.gov are source URLS which have moved to a new location at the National Archives, where they are then archived into the Wayback Machine. So if the National Archives location dies, we can add a web archive URL for it. This is a common source of a confusion, even though it contains "archive" somewhere in the URL, it is still the source location, which itself can have web archives. -- GreenC 16:16, 1 February 2025 (UTC)

Deprecating "soft-redirect" term

I've updated Wikipedia:Link_rot#Glossary to deprecate the term "soft-redirect". It has ambiguity with other meanings, and there is existing terminology for this concept: "mapped redirect" and "missing redirect". -- GreenC 23:06, 1 February 2025 (UTC)

seagames2021.com

58 pages. This domain is expired. Cherry Cotton Candy (talk) 15:05, 27 January 2025 (UTC)

Enwiki
  • Added 76 archives in 60 articles. Required special handling can't post regular stats.
IABot DB
  • Fixed a handful of links

 Done -- GreenC 01:11, 7 February 2025 (UTC)

alphabetilately.com

Site seems to have been usurped by spam. I've fixed a couple of links manually to point to archive but it looks like there are a couple dozen other articles that refer to this site. BoredPenguin (talk) 02:13, 30 January 2025 (UTC)

Actually it appears that the site still exists, but at https://alphabetilately.org. The URLs don't seem to have changed. BoredPenguin (talk) 02:15, 30 January 2025 (UTC)
5 pages. -- GreenC 00:33, 31 January 2025 (UTC)

Enwiki

  • Already done by someone else thanks

IABot DB

  • Done

 Done -- GreenC 01:22, 7 February 2025 (UTC)

iucnredlist.org

The website linked to by Template:IUCN Map has changed urls.

The template has been updated, but the species id parameter needs to be manually(?) updated from # to #/# to reflect the new folder structure.

The id can be determined by searching for the species name at [13] , and copying the numbers from the url, e.g. on the lesser yellowlegs page {{IUCN_Map|22693235|Tringa flavipes}} has been updated to {{IUCN_Map|22693235/208218115|Tringa flavipes}}

Around 400-500 pages are affected.

I will start poking away at it, but happy to have some help. Thanks! Random fixer upper (talk) 20:05, 23 January 2025 (UTC)

Manually searching 500 times is probably days or weeks of work. Do you have an API token, or can get one? [14] Then we can automate. The URL would look like this but it current says "Forbidden" without an API token (registration). More API endpoints here. Not sure which one provides the correct information. -- GreenC 23:18, 23 January 2025 (UTC)
Thanks for the reply! I have no particular knowledge of the site -- just trying to fix a dead link... I believe the purpose of the template is just to create a link to a webpage with an interactive map, so I'm not sure the API would help... it's possible the save option for the advanced search would give a table with species name and url that could make some sort of automating possible, but downloading the results requires logging in (which is beyond my personal commitment level at this time). Random fixer upper (talk)

Solution: with the same example, load this url [15] which searches the WaybackMachine for every URL https://www.iucnredlist.org/species/22693235/* (wildcard at the end). It gives a bunch not correct, one correct. For each, check the HTML source for the line:

<meta content='IUCN Red List of Threatened Species: Tringa flavipes' name='citation_title'>

.."Tringa flavipes" we are looking for. It's a match, so we know the second number is correct ie. 22693235/208218115 .. that's it, as far as building the map. From there it is plumbing to fix the template. I can do this, but need to get through previous projects first, including Whitehouse.gov. This is a fairly rare scenario, I call it a "Ruled inferred mapped redirect". -- GreenC 02:43, 24 January 2025 (UTC)

Random fixer upper, I was able to convert 370, unable to convert 57; conversion rate 87% (80/20 Rule). Rather than upload the conversions and discover there are errors, I posted 25 examples to Wikipedia:Link_rot/Cases/iucnredlist.org. Can you verify it looks OK, before I make the changes? Column 2 is the old and Column 3 is new. I also posted the 57 that require manual conversion. -- GreenC 19:48, 3 February 2025 (UTC)
I see a problem: with this, it says "not latest assessment". The message is generated by JavaScript, which is invisible to web scraping, nor does it show up in a headless browser. The correct page is this. The best solution I come up is sort the ID digits numerically and choose the one with the largest number, under the assumption they are assigning the numbers chrono and thus the largest number will be the latest page. This may or may not work out, it's the only solution I can think of. I'm currently reprocessing and will post updated sample results soon. -- GreenC 18:25, 4 February 2025 (UTC)
"Try 3" is a clean sweep. I'm going to call this problem solved and upload the diffs. This was an interesting project: exploring WaybackMachine CDX records to find possible codes, sorting those codes (tricky) into an inference table, and web scraping for titles strings. -- GreenC 21:05, 4 February 2025 (UTC)

Enwiki

  • Converted 370 {{IUCN Map}} to new ID codes.

 Done -- GreenC 21:07, 4 February 2025 (UTC)

@GreenC: That's great, thanks! Sorry I missed the request to check examples (my editing is sporadic). I'll start updating the one's that didn't migrate... Random fixer upper (talk) 19:47, 8 February 2025 (UTC)

carnegieendowment.org

The URL is dead. Thanks, David O. Johnson (talk) 21:06, 31 January 2025 (UTC)

84 pages -- GreenC 20:14, 1 February 2025 (UTC)
Or 1,268 pages to check the whole site. -- GreenC 20:16, 1 February 2025 (UTC)

Enwiki

Thanks. David O. Johnson (talk) 03:58, 10 February 2025 (UTC)
David O. Johnson: It appears the site has many soft-404s. For example this (2012 Georgia elections) redirects to this (2004 Bush administration). I'm doing my best to find and convert these to dead links with archive URLs, but it's imperfect. The bad ones mixed in randomly no pattern. It's a poorly maintained website, which is not uncommon, but worse than usual because of a random and high number of false redirects. I already committed some onwiki without realizing it. I could fix many more legit ones perhaps another 3 or 400, but without manually reviewing each, I can't safely build a redirect map. -- GreenC 19:52, 10 February 2025 (UTC)
That sucks. Thanks for letting me know. David O. Johnson (talk) 20:22, 10 February 2025 (UTC)

uptheposh.com

The domain www.uptheposh.com has been usurped, and all links (including sublinks like http://www.uptheposh.com/people/580/, http://www.uptheposh.com/seasons/115/transfers/) now redirect to an Indonesian gambling site Nina Gulat (talk) 16:43, 4 January 2025 (UTC)

Sounds like WP:JUDI. — Qwerfjkltalk 16:54, 4 January 2025 (UTC)

 Done in a WP:JUDI usurpation batch. -- GreenC 04:58, 16 February 2025 (UTC)

acig.org

Has been usurped by 1map.com. Needs adding archives and marked usurped Lyndaship (talk) 09:37, 7 January 2025 (UTC)

User:Lyndaship, thank you. Awaiting next WP:JUDI usurpation batch: Special:Diff/1267870649/1267991245 -- GreenC 17:29, 7 January 2025 (UTC)

 Done in a WP:JUDI usurpation batch. -- GreenC 04:58, 16 February 2025 (UTC)

vectorsite.net

This site died in 2012, until 2019 it went to Justhost, since then if you look at at archived page on wayback a file gets downloaded onto your computer. Putting a url directly into browser search brings up a squatter search site but with a url beginning ww3. Refill has in the past changed the cite url to one beginning ww1. Think it's safest to just archive and usurp the lot Lyndaship (talk) 12:50, 9 January 2025 (UTC)

Awaiting next WP:JUDI usurpation batch: Special:Diff/1268240877/1268396625 -- GreenC 15:26, 9 January 2025 (UTC)

 Done in a WP:JUDI usurpation batch. -- GreenC 04:59, 16 February 2025 (UTC)

arkivnamnden.org

This used to host the public archives of the Swedish city Göteborg. The archives moved to a new address starting from 2019. It is now displaying casino ads.

Example of use: https://sv.wikipedia.orghttps://demo.azizisearch.com/lite/wikipedia/page/Kungsladug%C3%A5rd,_G%C3%B6teborg#cite_note-12

https://web.archive.org/web/20200220132929/http://arkivnamnden.org/ - information about address change https://web.archive.org/web/20210413012018/https://arkivnamnden.org/ - up for sale https://web.archive.org/web/20230605133707/https://arkivnamnden.org/ - still for sale https://web.archive.org/web/20250105093523/https://arkivnamnden.org/ - casino ads

Should probably be marked as usurped and what has not already been changed to archive links should do that. 98.128.246.108 (talk) 14:19, 9 January 2025 (UTC)

Awaiting next WP:JUDI usurpation batch: Special:Diff/1268240877/1268396625 -- GreenC 15:26, 9 January 2025 (UTC)

 Done in a WP:JUDI usurpation batch. -- GreenC 04:59, 16 February 2025 (UTC)

Tornado History Project and crh.noaa.gov

tornadohistoryproject.com

Links to tornadohistoryproject.com (a widely used source run by the Storm Prediction Center less than a decade ago, especially on older articles written before 2015) now redirect to an unaffiliated third-party essay writing service. Links should be considered usurped and dead where no archive URL is available.

Awaiting next batch at WP:JUDI -- GreenC 20:18, 1 February 2025 (UTC)

 Done in a WP:JUDI usurpation batch. -- GreenC 04:59, 16 February 2025 (UTC)

crh.noaa.gov

Links to crh.noaa.gov (individual National Weather Service WFO summaries for severe weather events) are dead, but many still remain online on the new weather.gov domain. For instance, http://www.crh.noaa.gov/dlh/?n=1991halloweenblizzard can now be found at https://www.weather.gov/dlh/1991halloweenblizzard - the syntax is different but can be reasonably changed and the site contents are the same. I'm not sure why crh.noaa.gov isn't a redirect but regardless it's still used in a hell of a lot of weather articles and should be salvaged rather than just labeled as dead where possible. I think this also extends to other domains - if I'm not mistaken, crh is Central Region Headquarters, and there are likely others in the South and a few other parts of the country. Departure– (talk) 14:21, 30 January 2025 (UTC)

Hi, User:Departure–, there are 247 pages but a lot don't look like they map to the rule. I can try. Do you know of other domains? -- GreenC 22:16, 1 February 2025 (UTC)
http://www.crh.noaa.gov/bou/?n=consec90 (cited on the page Colorado) on the CRH domain appears to map to https://www.weather.gov/bou/DenverSummerHeat if I'm not mistaken. However, this is just a contemporary equivalent and the original content of the site is not present, and I believe it has indeed been lost. I think a lot of the CRH links are dead but I know a lot of them can be recovered by transitioning to the weather.gov domains. Departure– (talk) 22:21, 1 February 2025 (UTC)
In other words, a lot of links do follow the rule but a lot don't as they have been replaced. From what I can tell, a lot of links have been standardized with no clear rule to find the new one. However, many non-climate stories are still online, such as http://www.crh.noaa.gov/ilx/?n=spi-tornado (cited in Springfield, Illinois) which can now be found at www.weather.gov/ilx/12mar06-tor2 - inputting the title from the cite template into https://search.usa.gov/search?v%3Aproject=firstgov&query=&affiliate=nws.noaa.gov can be used to recover links where the rule does'nt apply, assuming the site's content isn't lost. Departure– (talk) 22:25, 1 February 2025 (UTC)
This is tricky because if I replace a dead link with a new live link, but the live link has different content, the old dead link is lost we don't know what the original link was anymore. But if I keep the old dead link, plus add an archive URL, then the content is preserved. Thus the safer option is to add archives. Like the DenverSummerHeat example could be converted to this which is serviceable. -- GreenC 01:30, 7 February 2025 (UTC)

silverscreen.in

It seems the site is slowly dying. They ceased publishing new content in June 2022 due to COVID-19, and although they said the site would still be accessible, I don't know since when it hasn't been. The site's domain was previously silverscreen.in, and that must be dealt with too. Kailash29792 (talk) 05:06, 8 February 2025 (UTC)

According to the WaybackMachine it was last available on January 1 2025. That's an ominous date, first of the year, suggesting cut off. But it may be too soon to determine, I've seen sites disappear then return months or years later. In the mean time we have dead links. It's only 247 pages. There's nothing for the .in version. Well, technically speaking I can move cites from live to dead, then dead to live again. Recommend treat it as a dead site now, and if returns to the living, reinstate it. -- GreenC 05:19, 8 February 2025 (UTC)
It was active even in mid-January. Maybe I was unclear about the original domain. It was https://silverscreen.in Kailash29792 (talk) 05:57, 8 February 2025 (UTC)
silverscreen.in has 364 pages. Do you want to do just that one for now, and check back on silverscreenindia.com later? -- GreenC 01:26, 9 February 2025 (UTC)
Yeah, tag 'em dead. Silverscreenindia.com continues to show G-hits, although the links are not accessible. Kailash29792 (talk) 04:05, 9 February 2025 (UTC)

Enwiki

  • Checked 363 pages and edited 331 pages. Added 62 {{dead link}}. Switched 173 |url-status=live to dead. Added 139 archive URLs (136 Wayback). Changed 8 citation metadata.

IABot DB

  • Updated 536 unique URLs which propagate through 300+ wikis

 Done -- GreenC 08:03, 17 February 2025 (UTC)

airfields-freeman.com

672 pages. New domain is airfieldsfreeman.com. Cuba200611 (talk) 02:33, 10 January 2025 (UTC)

In addition many can be converted to .htm
  1. https://www.airfieldsfreeman.com/KS/Airfields_KS_Wichita.html
  2. https://www.airfieldsfreeman.com/KS/Airfields_KS_Wichita.htm
-- GreenC 18:53, 12 January 2025 (UTC)
25 URLs

-- GreenC 19:44, 12 January 2025 (UTC)

I fixed the remaining URLs. Cuba200611 (talk) 07:14, 19 February 2025 (UTC)

Enwiki

  • Checked 674 pages and edited 664 pages. Moved 841 links to a new URL: 841 ruled mapped redirects, Added 3 {{dead link}}. Switched 62 |url-status=dead to live. Added 25 archive URLs (24 Wayback). Changed 95 citation metadata.

 Done -- GreenC 19:44, 12 January 2025 (UTC)

heritage.org

Following an RfC, www.heritage.org has been blacklisted for being a cybersecurity risk. All URLs in citations should be archived and switched to url-status=unfit so that users don't accidentally click malicious links. Nemo 10:00, 12 February 2025 (UTC)

1,079 pages. Will be changing to "unfit" status. -- GreenC 17:23, 16 February 2025 (UTC)

Enwiki

  • Checked 1,079 pages and edited 1,065 pages. Switched 1,430 to |url-status=unfit. Added 779 archive URLs (739 Wayback).
(fixed a couple dozen manually)

 Done -- GreenC 21:23, 16 February 2025 (UTC)

Thanks! Nemo 17:05, 19 February 2025 (UTC)

usaid.gov

Blanked page. 1,768 pages. -- GreenC 16:31, 19 February 2025 (UTC)

Enwiki

  • Checked 1,767 pages and edited 1,347 pages. Added 26 {{dead link}}. Switched 137 |url-status=live to dead. Added 1,511 archive URLs (1,472 Wayback). Changed 499 citation metadata.

 Done -- GreenC 04:17, 20 February 2025 (UTC)