mic_none

Wikipedia:Link rot/URL change requests Source: en.wikipedia.org/wiki/Wikipedia:Link_rot/URL_change_requests

Shortcut

This page is for requesting modifications to URLs, such as marking dead or changing to a new domain. Some bots are designed to fix link rot; they can be notified here. These bots include InternetArchiveBot and WaybackMedic. This page can be monitored by bot operators from other language wikis since URL changes are universally applicable.


Archives (Index)

This page is archived by ClueBot III.

finlex.fi discussion

[edit]

Finlex.fi URLs aren't dead but for some reason InternetArchiveBot keeps adding archived URLs for them. This was brought up at meta:User talk:InternetArchiveBot#Finlex.fi URLs aren't dead a month ago: Bot's edits: [1], [2], [3]. Some URLs it tagged as dead but are actually working: [4], [5], [6]. Those finlex.fi URLs that now have both a working URL and an archive URL should be tagged with the |url-status=live tag, and could someone try to tell IABot that Finlex is live? Thanks. 2001:14BA:9C94:9A00:E866:DADA:1085:E3D9 (talk) 09:28, 17 March 2024 (UTC)[reply]

Just noticed that this same issue is being discussed at fi.wikipedia: fi:Wikipedia:Kahvihuone (tekniikka)#Botti hakee arkistosta kumottuja lakeja 2001:14BA:9C94:9A00:E866:DADA:1085:E3D9 (talk) 09:41, 17 March 2024 (UTC)[reply]
The site has a "Are you human?" check box (CloudFlare). This is causing the bot to think it's a dead site. I logged into iabot.org and changed the domain to "Subscription" status and that will cause the bot to avoid this domain, it won't set live or dead. My bot WaybackMedic has capabilities to bypass CloudFlare. I can try to process this domain and see what happens. My bot also has a feature "make live" ie. convert a citation from dead to live state. Unfortunately my bot only works on English Wikipedia. I'll let you know what happens. -- GreenC 15:13, 17 March 2024 (UTC)[reply]
Unfortunately, this site has maximum security enabled, none of my tools can get through. It started happening in late January 2024. I don't know what to do because no bot is able to determine if a link is live or dead. And no archive service such as WaybackMachine is able to archive a page. Only humans can get through, and they need to solve a captcha. It might be worthwhile waiting to see if they relax security in the future, since this is a recent development. -- GreenC 00:40, 19 March 2024 (UTC)[reply]
@GreenC: Before this section gets archived and if it's easy/fast to check, can you check if this is still the case, i.e. that the site still has the maximum security enabled and no tool/bot can get through? Thank you. 85.76.109.152 (talk) 06:21, 2 June 2024 (UTC)[reply]
Question? When going to [7] it still asks "Are you human?" with the CloudFlare security tag at the bottom. This is a feature of CloudFlare service, clients have the option to enable, it's the highest level of security. I'm not aware of a tool that can bypass. What I will do is set a reminder in 6 months to check again and post the results here. I use W-Ping which posts a reminder in the watchlist at whatever time in the future with a custom message. -- GreenC 16:06, 2 June 2024 (UTC)[reply]
Still on CloudFlare. -- GreenC 03:21, 2 December 2024 (UTC)[reply]
Looks like the captcha might have been removed – I'm not getting one on that link at the moment. Save Page Now also works. 2A00:807:D3:B2CD:1D64:EE5:ECA4:CA80 (talk) 08:40, 25 April 2025 (UTC)[reply]
Yes one year later captcha lifted. I put this on my schedule to correct the dead link status (on Enwiki). I just reset the domain status in iabot.org to alive. -- GreenC 01:49, 3 May 2025 (UTC)[reply]

This should be completed see Wikipedia:Link rot/URL change requests#finlex.fi. Any problems let me know. -- GreenC 18:26, 9 May 2025 (UTC)[reply]

Great to hear, thanks! (OP) 87.95.243.221 (talk) 16:36, 12 May 2025 (UTC)[reply]

{{dead link}} verification

[edit]

Every few years, I check all links marked with {{dead link}} and attempt to discover archive URLs for them. WaybackMedic has advanced search technology that can discover archives other tools miss. Typically about a 15% success rate. This is a large project and slow due to the number of articles, currently about 300,000. I do it in batches of 30-50 thousand articles, which takes a few days to process. The statistics/results for each batch will be posted in this section. This job consumes all bot resources, it will be on and off while doing other projects in between batches. -- GreenC 18:45, 10 January 2025 (UTC)[reply]

Enwiki

  • Checked 316,776 pages. Edited 51,694 pages. Added 54,626 archive URLs.

IABot DB

  • Updated 40,586 unique URLs which propagate through 300+ wikis

 Done -- GreenC 17:55, 1 February 2025 (UTC)[reply]

itunes.apple.com

[edit]

30,121 pages. A general sweep looking for dead links and redirects. -- GreenC 16:28, 13 March 2025 (UTC)[reply]

Enwiki

Pass 1 (00001-00500): Checked 500 pages and edited 473 pages. Moved 919 links to a new URL: 917 normal redirects, 2 ruled mapped redirects, Added 130 {{dead link}}. Switched 18 |url-status=dead to live. Switched 63 |url-status=live to dead. Added 388 archive URLs (386 Wayback). Changed 109 citation metadata.
Pass 2 (00501-08000): Checked 7,504 pages and edited 6,939 pages. Moved 9,327 links to a new URL: 9,307 normal redirects, 20 ruled mapped redirects, Removed 2 {{dead link}}. Added 749 {{dead link}}. Switched 252 |url-status=dead to live. Switched 609 |url-status=live to dead. Added 4,058 archive URLs (4,025 Wayback). Changed 1,647 citation metadata.
Pass 3 (08001-16000): Checked 8,003 pages and edited 7,373 pages. Moved 9,888 links to a new URL: 9,871 normal redirects, 17 ruled mapped redirects, Removed 2 {{dead link}}. Added 1,075 {{dead link}}. Switched 235 |url-status=dead to live. Switched 553 |url-status=live to dead. Added 4,412 archive URLs (4,379 Wayback). Changed 1,392 citation metadata.
Pass 4 (16001-24000): Checked 8,000 pages and edited 7,439 pages. Moved 10,169 links to a new URL: 10,151 normal redirects, 18 ruled mapped redirects, Removed 1 {{dead link}}. Added 1,026 {{dead link}}. Switched 191 |url-status=dead to live. Switched 615 |url-status=live to dead. Added 4,683 archive URLs (4,635 Wayback). Changed 1,538 citation metadata.
Pass 5 (24001-30121): Checked 6,123 pages and edited 5,667 pages. Moved 7,681 links to a new URL: 7,669 normal redirects, 12 ruled mapped redirects, Removed 3 {{dead link}}. Added 734 {{dead link}}. Switched 180 |url-status=dead to live. Switched 522 |url-status=live to dead. Added 3,526 archive URLs (3,487 Wayback). Changed 1,227 citation metadata.
Note: Many of the links marked dead or with archives added are in fact available on the live web at a different URL, the redirects only need to be mapped. The mapping can be done by using the Apple search engine. However it is not precise, and would be difficult. A project for another day. -- GreenC 19:21, 19 March 2025 (UTC)[reply]

IABot DB

 Done -- GreenC 19:21, 19 March 2025 (UTC)[reply]

uefa.com

[edit]

24,087 pages. -- GreenC 00:10, 20 March 2025 (UTC)[reply]

Enwiki

Pass 1 (00000-01000): Checked 1,000 pages and edited 703 pages. Moved 1,477 links to a new URL: 360 normal redirects, 1,092 ruled mapped redirects, 25 ghost mapped redirects, Resolved 219 soft-404s. Removed 1 {{dead link}}. Added 67 {{dead link}}. Switched 30 |url-status=dead to live. Switched 45 |url-status=live to dead. Added 462 archive URLs (351 Wayback). Changed 1,600 citation metadata.
Pass 2 (01001-06000): Checked 5,000 pages and edited 3,424 pages. Moved 8,108 links to a new URL: 1,654 normal redirects, 6,297 ruled mapped redirects, 157 ghost mapped redirects, Resolved 1,388 soft-404s. Removed 4 {{dead link}}. Added 393 {{dead link}}. Switched 104 |url-status=dead to live. Switched 234 |url-status=live to dead. Added 2,857 archive URLs (2,430 Wayback). Changed 5,553 citation metadata.
Pass 3 (06001-12000): Checked 6,001 pages and edited 4,097 pages. Moved 9,927 links to a new URL: 2,011 normal redirects, 7,740 ruled mapped redirects, 176 ghost mapped redirects, Resolved 1,910 soft-404s. Removed 1 {{dead link}}. Added 525 {{dead link}}. Switched 146 |url-status=dead to live. Switched 269 |url-status=live to dead. Added 3,078 archive URLs (2,588 Wayback). Changed 5,970 citation metadata.
Pass 4 (12001-18000): Checked 6,000 pages and edited 4,070 pages. Moved 9,681 links to a new URL: 2,069 normal redirects, 7,340 ruled mapped redirects, 272 ghost mapped redirects, Resolved 2,228 soft-404s. Removed 5 {{dead link}}. Added 560 {{dead link}}. Switched 114 |url-status=dead to live. Switched 373 |url-status=live to dead. Added 3,157 archive URLs (2,717 Wayback). Changed 5,409 citation metadata.
Pass 5 (18001-24087): Checked 6,089 pages and edited 4,178 pages. Moved 10,300 links to a new URL: 1,862 normal redirects, 8,224 ruled mapped redirects, 214 ghost mapped redirects, Resolved 2,386 soft-404s. Removed 7 {{dead link}}. Added 524 {{dead link}}. Switched 147 |url-status=dead to live. Switched 321 |url-status=live to dead. Added 3,571 archive URLs (3,024 Wayback). Changed 6,115 citation metadata.

IABot DB

 Done -- GreenC 22:44, 29 March 2025 (UTC)[reply]

af.mil

[edit]

The Pentagon needs assistance. About 9,000 pages. -- GreenC 03:51, 20 March 2025 (UTC)[reply]

Enwiki

IABot DB

  • Checked about 24,000 unique URLs. Updated about 10,000.

 Done -- GreenC 02:28, 1 April 2025 (UTC)[reply]

dn.se

[edit]

First time here. While editing I found the dead link http://www.dn.se/sport/fotboll/lennart-johanssons-pokal-opererad-1.1228512 could be replaced by https://www.dn.se/sport/fotboll/lennart-johanssons-pokal-opererad/. There looks to be at least some 100 of these where the -1.(six or seven digits) may be removed to create functional links. https possible. Kaffet i halsen (talk) 20:01, 20 March 2025 (UTC)[reply]

3,100 pages. -- GreenC 03:37, 31 March 2025 (UTC)[reply]

Enwiki

Of the 1,855 ruled mapped redirects 346 were of the "-1.xxx" variety. The rest were conversion to https.

 Done -- GreenC 05:14, 1 April 2025 (UTC)[reply]

usip.org

[edit]

United States Institute of Peace was forceably shutdown by DOGE with help from DC Capital Police (guns involved by not fired). Website was shut down. 933 pages. -- GreenC 19:16, 21 March 2025 (UTC)[reply]

Enwiki

  • Checked 936 pages and edited 758 pages. Added 52 {{dead link}}. Switched 158 |url-status=live to dead. Added 681 archive URLs (599 Wayback). Changed 114 citation metadata.

IABot DB

  • Checked about 1,100 unique links and updated about the same. Changed domain status permadead.

 Done -- GreenC 16:45, 1 April 2025 (UTC)[reply]

US agencies slated for shutdown or dismantling

[edit]

GreenC 21:24, 21 March 2025 (UTC)[reply]

ω Awaiting further developments and time to go through them -- GreenC 16:46, 1 April 2025 (UTC)[reply]

90 agencies identified as having web pages deleted during the Trump admin: https://asia.nikkei.com/static/vdata/infographics/deleted-website/ 

White House
Department of Health and Human Services
Department of Agriculture
USAID
National Park Service
worker.gov
Department of Labor
Federal Highway Administration
Environmental Protection Agency
Department of Housing and Urban Development
Centers for Disease Control and Prevention
Department of Transportation
Federal Emergency Management Agency
National Institutes of Health
General Services Administration
Department of Homeland Security
Department of Commerce
employer.gov
Office of the Assistant Secretary for Health
sftool.gov
Department of Energy
Department of the Interior
Department of Education
NOAA
Substance Abuse and Mental Health Services Administration
climate.gov
Department of Defense
Health Resources & Services Administration
AbilityOne Commission
Department of State
United States Patent and Trademark Office
BOEM
The Census Bureau
CISA
HUD User
MILLENNIUM CHALLENGE CORPORATION
performance.gov
National Archives and Records Administration
Bureau of Safety and Environmental Enforcement
Federal Aviation Administration
Food and Drug Administration
House of Representatives
Department of Justice
National Endowment for the Humanities
Department of the Treasury
youth.gov
American Climate Corps
Federal Trade Commission
Global Change Research Program
NASA
Administration for Community Living
National Endowment for the Arts
ATF
Bureau of Indian Affairs
Customs and Border Protection
Consumer Financial Protection Bureau
Consumer Product Safety Commission
Office of the Director of National Intelligence
Economic Development Administration
Equal Employment Opportunity Commission
Export-Import Bank of the United States
FBI
Federal Committee on Statistical Methodology
Federal Housing Finance Agency
geoplatform.gov
Assistant Secretary for Technology Policy
IRS
National Labor Relations Board
Office of Personnel Management
Department of Veterans Affairs
American Battle Monuments Commission
Agency for Healthcare Research and Quality
americorps.gov
Advanced Research Projects Agency for Health
Bonneville Power Administration
cms.gov
congress.gov
digital.gov
ENERGY STAR
ej.gov
farmers.gov
medicalcountermeasures.gov
peacecorps.gov
Securities and Exchange Commission
Social Security Administration
stopbullying.gov
Citizenship and Immigration Services
United States Interagency Council on Homelessness
workcenter.gov
Air Force
Marine Corps

redimps.co.uk

[edit]

not entirely sure how to format this request but this domain is no longer active, and used on 234 pages. pages live at new domain weareimps.com, with a link such as https://www.redimps.co.uk/news/2021/january/210106-tommy-docherty/ salvageable by changing the domain ([8]). links ending .aspx cannot be saved by changing domain - [9] is still live at [10] but no way to arrive at this by just changing the domain. Microwave Anarchist (talk) 01:46, 22 March 2025 (UTC)[reply]

Can do this. Anything that can't migrate will convert to archive URL. Have a few to get through above first. -- GreenC 03:06, 22 March 2025 (UTC)[reply]

Enwiki

  • Checked 235 pages and edited 91 pages. Moved 105 links to a new URL: 105 ruled mapped redirects, Added 8 {{dead link}}. Switched 3 |url-status=dead to live. Switched 2 |url-status=live to dead. Added 37 archive URLs (34 Wayback). Changed 2 citation metadata.
The 105 moved links are redimps.co.uk --> weareimps.com
  • Pass 2: Checked 235 pages and edited 63 pages. Added 33 {{dead link}}. Switched 2 |url-status=live to dead. Added 94 archive URLs (77 Wayback). Changed 1 citation metadata.
Realized the 404s were returning 200 (soft-404). Re-ran it adding more archives.

IABot DB

  • Checked about 800 unique links and updated. Set domain status to permadead

 Done -- GreenC 19:00, 1 April 2025 (UTC)[reply]

thetimes.co.uk

[edit]

The Times migrated from thetimes.co.uk to thetimes.com in 2024. There are instances of URLs across Wikipedia that reference the .co.uk domain. For example, the page for Russell Brand references this URL. There are over 22,000 links discovered here. Lukethetimes (talk) 11:29, 24 March 2025 (UTC)[reply]

This site is disorderly:
  • thetimes.co.uk
  • timesplus.co.uk
  • timesonline.co.uk
  • thesundaytimes.co.uk
  • thetimes.com
There are probably others. I worked on it 6 months ago Wikipedia:Link rot/URL change requests/Archives/2024/October but clearly more to go. It had a ton of soft-404 problems making it challenging to differentiate between live and dead links. Maybe I'll just focus on thetimes.co.uk and see what happens. -- GreenC 18:59, 1 April 2025 (UTC)[reply]
Thank you so much for picking these up. I had one query to check - I can see the URLs tackled in this list successfully redirect to the .com domain, however don't pick up our subfolders. For example, in the references for the Woken page:
Corr, Julieanne. "Irish beach the scene for new feature film". The Times.
The pathway of the referenced URL is .com/article. However, the canonical URL is on the pathway .com/world/ireland-world/article.
Please would it be possible for the canonical URL paths to be added? Thank you, I appreciate that's an added step! Lukethetimes (talk) 08:16, 2 April 2025 (UTC)[reply]
User:Lukethetimes: The step is built-in to the boilerplate code. It follows redirects to the final destination. I just re-ran Woken a couple times, and am getting inconsistent header results. Sometimes it returns 301 with a new Location, and sometimes a plain 200. In the 301 header there is X-Cache: Miss from cloudfront while in the 200 header X-Cache: Hit from cloudfront. I'll send you the full headers if you like. -- GreenC 15:10, 2 April 2025 (UTC)[reply]
Sorry I became confused by the data, the 200 header is actually of the canonical URL, which is correctly 200. Anyway, I don't understand why it didn't follow the redirect because when I try it now it is following to the canonical URL. Did you make any changes on your side, in the past 12 hours or so? -- GreenC 15:23, 2 April 2025 (UTC)[reply]
It looks like possibly an intermittent problem. After processing all links, there are about 8,000 with ".com/article" .. the rest are the canonical. I suspect header data might be inconsistent. -- GreenC 15:31, 2 April 2025 (UTC)[reply]
I'm going to finish uploading the rest. In the future can redo the .com URLs looking for redirects and changing them again during another phase. Hopefully by then this problem will have resolved, it looks like a problem with CloudFlare or Times sending incorrect headers, but inconsistently. -- GreenC 02:18, 3 April 2025 (UTC)[reply]
Thanks so much for getting back to me so quickly. That's interesting there's inconsistency with incorrect headers, I'll take this away on my side. Appreciate your help with this! Lukethetimes (talk) 09:23, 3 April 2025 (UTC)[reply]
This is appearing easier than timesonline.co.uk (6 months ago) because redirects are still live for thetimes.co.uk

Enwiki

Pass 1 (00001-01000): Checked 1,000 pages and edited 995 pages. Moved 1,300 links to a new URL: 50 normal redirects, 1,246 ruled mapped redirects, 4 ghost mapped redirects, Resolved 16 soft-404s. Added 5 {{dead link}}. Switched 41 |url-status=dead to live. Switched 2 |url-status=live to dead. Added 31 archive URLs (17 Wayback). Changed 42 citation metadata.
Pass 2 (01000-10000): Checked 9,000 pages and edited 8,974 pages. Moved 11,640 links to a new URL: 426 normal redirects, 11,098 ruled mapped redirects, 116 ghost mapped redirects, Resolved 155 soft-404s. Removed 3 {{dead link}}. Added 62 {{dead link}}. Switched 330 |url-status=dead to live. Switched 27 |url-status=live to dead. Added 182 archive URLs (112 Wayback). Changed 4,939 citation metadata.
Pass 3 (10001-22277): Checked 12,277 pages and edited 12,232 pages. Moved 15,986 links to a new URL: 622 normal redirects, 15,219 ruled mapped redirects, 145 ghost mapped redirects, Resolved 231 soft-404s. Added 98 {{dead link}}. Switched 469 |url-status=dead to live. Switched 35 |url-status=live to dead. Added 325 archive URLs (216 Wayback). Changed 7,469 citation metadata.

IABot DB

  • Uploaded the apx 570 archive links identified above. Not confident to process the entire domain until the intermittency problem is understood.

 Done -- GreenC 02:52, 3 April 2025 (UTC)[reply]

m.mlb.com

[edit]

Back again. Every single one of these links to m.mlb.com ALWAYS gets redirected to mlb.com, path ignored, making links useless.

Some things to help with:

  1. News articles.
    1. Prior they look like this: http://m.mlb.com/news/article/155452870/top-facts-about-mets-royals-world-series (the part after the ID may be omitted)
    2. If you take that ID and do this: http://mlb.com/news/c-155452870
    3. It gets expanded into this: https://www.mlb.com/news/top-facts-about-mets-royals-world-series/c-155452870
  2. Gameday links.
    1. Prior they look like this: https://m.mlb.com/gameday/mets-vs-cardinals/2016/08/23/448740
    2. These can just safely be replaced with mlb.com, removing the m.
    3. They would just get turned into this: https://mlb.com/gameday/mets-vs-cardinals/2016/08/23/448740
  3. MLB Cutfour/4
    1. Prior they look like this: http://m.mlb.com/cutfour/2015/05/06/122710430/did-you-know-that-george-clooney-tried-out-for-the-reds-in-1977 (the ending part after the ID may be omitted)
    2. Like with news, but keep the cutfour and change it to cut4, and get the ID from the middle (after date): https://www.mlb.com/cut4/c-122710430
    3. Gets expanded into this: https://www.mlb.com/cut4/did-you-know-that-george-clooney-tried-out-for-the-reds-in-1977/c-122710430
  4. Player links.
    1. They look like this: http://m.mlb.com/player/645277/ozzie-albies (the /ozzie etc part at the end may be omitted, you only need the 6 digit ID)
    2. They can just be replaced with https://www.mlb.com/player/645277 (or if you remove the m, https://mlb.com/player/645277/ozzie-albies)
    3. Regardless, they will expand into https://www.mlb.com/player/ozzie-albies-645277
  5. Anything else, just remove the m. and see what happens. If it's a redirect to mlb.com with nothing else, mark it as dead. If it redirects somewhere useful (if you can even check), or it doesn't redirect at all, it should be okay to just replace without the m (for example, http://m.mlb.com/glossary/rules/balk turns into https://mlb.com/glossary/rules/balk with no issue). Some of the above things, especially 1 and 3, might end up as dead, unfortunately (like http://m.mlb.com/news/article/83873114/ten-facts-for-100th-anniversary-of-babe-ruths-debut would turn into http://mlb.com/news/c-83873114 but this is dead). Players and gameday should never come up as dead, as all these IDs should still work.

This would rescue a bunch of links, there are 2,048 m.mlb.com links floating around and saving even half of them would be a huge help. Chew(V • T • E) 21:17, 25 March 2025 (UTC)[reply]

Thanks for laying out clear rules that makes it easier to setup. I think most of them are resolved one way or another. There are 1,200 remaining but many of those converted to www.mlb.com, they just have old archive URLs showing up in search. -- GreenC 02:18, 4 April 2025 (UTC)[reply]

Enwiki

IABot DB

  • Checked and updated about 10,000 unique URLs

 Done -- GreenC 02:42, 4 April 2025 (UTC)[reply]

zap2it.com

[edit]

Site moved to a new provider. More details at Wikipedia talk:WikiProject Television#Possible Zap2it closure - what to do?. Over 11,000 pages. -- GreenC 22:48, 26 March 2025 (UTC)[reply]

Enwiki

IABot DB

  • The database has about 30,000 unique URLs. I uploaded about 5,000 changes set the domain globally to permadead

 Done -- GreenC 04:54, 5 April 2025 (UTC)[reply]

gameinformer.com

[edit]

The site has been revived following the site's shutdown in August 2024. A request was made then (here), and I believe that should now be essentially reversed, where all uses of https://www.gameinformer.com should be adjusted from |url-status=dead to |url-status=live. I've picked a very, very small handful of links in use on articles to check original urls and they all seem good and active. - Favre1fan93 (talk) 00:16, 27 March 2025 (UTC)[reply]

I'll do a "makelive" which blindly converts everything to live status and removes {{dead link}} (keeping any archive URL). Then I'll do a second pass looking for legitimate dead links and convert those to dead status. It's churn, but that's how the bot works it needs two passes. Hopefully not too many dead links. 6,500 pages. -- GreenC 01:00, 5 April 2025 (UTC)[reply]
Thank you! - Favre1fan93 (talk) 15:42, 5 April 2025 (UTC)[reply]
There are some ancient links that were already dead when the site was disestablished. These area accidentally being marked as live, e.g. here. IceWelder [✉] 18:31, 5 April 2025 (UTC)[reply]
They are currently being repaired in "Pass 2" (below). I first changed all links to live, in Pass 1, and in Pass 2 recheck them and set to dead as needed. Turned out to be about 2,600 dead links. -- GreenC 18:35, 5 April 2025 (UTC)[reply]
I think Pass 2 is not capturing them correctly. In this case, it https-ified the broken link. IceWelder [✉] 18:52, 5 April 2025 (UTC)[reply]
User:IceWelder, thanks for this. [11] returns header status 200 thus considered live by the bot. The page has a "Crunchy-404" appearance ie. it has some content but is missing the actual review. It even gives a title, author and date. But wrong information. I can reprocess everything in Pass 3 and check the page for the string "Sorry, no reviews are available for this platform." - If you find any more like this let me know I will add additional rules. -- GreenC 19:08, 5 April 2025 (UTC)[reply]
Unfortunately, not working so far (assuming this was pass 3). IceWelder [✉] 18:27, 6 April 2025 (UTC)[reply]

Enwiki

  • Pass 1: Checked 6,565 pages and edited 6,414 pages. Removed 31 {{dead link}}. Switched 9,914 |url-status=dead to live.
Note: the stats don't report everything, like removing archive URLs from square links etc
  • Pass 2: Checked 6,565 pages and edited 4,260 pages. Moved 3,598 links to a new URL: 139 normal redirects, 3,459 ruled mapped redirects, Resolved 318 soft-404s. Added 31 {{dead link}}. Switched 1 |url-status=dead to live. Switched 2,579 |url-status=live to dead. Added 37 archive URLs (28 Wayback). Changed 35 citation metadata.
Note: Over 2,600 dead links discovered. The 3,459 ruled mapped redirects is mostly http -> https
  • Pass 3: Checked 6,565 pages and edited 296 pages. Moved 61 links to a new URL: 61 normal redirects, Resolved 609 soft-404s. Added 31 {{dead link}}. Switched 3 |url-status=dead to live. Switched 317 |url-status=live to dead. Added 2 archive URLs (2 Wayback).
Note: Found another 319 dead links that are soft/crunchy 404s per above

IABot DB

  • Checked about 12,000 URLs

 Done -- GreenC 00:44, 6 April 2025 (UTC)[reply]

nakedsecurity.sophos.com

[edit]

Entire domain https://nakedsecurity.sophos.com is dead. URLs can sometimes be salvaged by changing the domain to news.sophos.com leaving the path unchanged (i.e https://nakedsecurity.sophos.com/en-us/2016/08/18/nists-new-password-rules-what-you-need-to-know/ -> https://news.sophos.com/en-us/2016/08/18/nists-new-password-rules-what-you-need-to-know/ ) * Pppery * it has begun... 16:09, 29 March 2025 (UTC)[reply]

154 pages -- GreenC 18:56, 5 April 2025 (UTC)[reply]

Enwiki

Summary: made 78 live to "news". 104 are dead.

IABot DB

  • Processed 284 unique links

 Done -- GreenC 15:18, 6 April 2025 (UTC)[reply]

abc.net.au/news/stories

[edit]

This is now here for Reaction Time (book), but unfortunately does not redirect. It also can't be converted to the new URL as the id does not match. ~3400 articles. Thank you! MrLinkinPark333 (talk) 23:57, 29 March 2025 (UTC)[reply]

Enwiki

  • Checked 3,480 pages and edited 3,322 pages. Added 31 {{dead link}}. Switched 959 |url-status=live to dead. Added 3,734 archive URLs (2,604 Wayback).

IABot DB

  • Processed and updated 5,500 unique links

 Done -- GreenC 00:32, 7 April 2025 (UTC)[reply]

wayback.archive.org

[edit]

Found ~50 articles using wayback.archive.org. Thought I mention it here cause of WaybackMedic. Also, for some reason Rich Harden and Truce of Altmark have archive.today links that archived wayback.archive.org links. This does make me wonder if there are any other archive.org links that have archive.today in the URL. Haven't figured out the syntax for that. MrLinkinPark333 (talk) 00:09, 30 March 2025 (UTC)[reply]

I wrote a program that runs automatically every 2 weeks converting non-standard Wayback domains like this one to web.archive.org. It won't convert strings outside a URL, URLs with a timestamp with a "*", URLs in a wiki comment, etc.. so that is probably most of it, various edge cases that would be better done by hand. Not too concerned with the double archives at Archive.today they exist but in small numbers. WaybackMedic can unwind double/triple archives when encountered. -- GreenC 18:52, 5 April 2025 (UTC)[reply]

thepogg.com

[edit]

The website redirects to a different site. Thanks, David O. Johnson (talk) 21:07, 31 March 2025 (UTC)[reply]

 Done in WP:JUDI batch #27 -- GreenC 15:23, 5 May 2025 (UTC)[reply]

www.olympic.org.nz

[edit]

Most of them links have new locations at https://olympic.org.nz/ while some need archives

Games

  1. This is now here for 1980 Summer Olympics (/games/location-year)
  2. Similarly, Most links with /games/ can be converted. This is now here for Shane O'Brien (rower) while this is now here for New Zealand at the 2018 Summer Youth Olympics.
  3. However, this link for Sam Webster (cyclist) doesnt have a replacement.

Athletes

  1. This is now here for Ryan Nelsen (/athletes/firstname-lastname)
  2. Similarly, this is now here for Greg Henderson
  3. Also, this is now here for Peter Mander.
  4. [12] can be converted to [13] (lowercase)
  5. [14] can be converted to [15] (lowercase)

News

  1. Some /news/ are the same URLs. They need the ending slash removed. For example. this is now here at 2018 Commonwealth Games.
  2. Other /news/ links are broken, such as this one at New Zealand at the 1948 Summer Olympics
  3. Urls with /nzoc/news/ don't have replacements, like this one at 2010 Commonwealth Games.

Any other links not in these 3 categories needs archives as I don't see replaceable links. ~900 articles. Thank you! MrLinkinPark333 (talk) 00:55, 2 April 2025 (UTC)[reply]

User:MrLinkinPark333, I can make rules for Games#2 and Athletes#2 and Athletes#4 and Athletes#5 and News#1 .. the rest I don't see a good way -- GreenC 03:09, 7 April 2025 (UTC)[reply]
Also note broken links like this return status code "200" it should be 404 ie. soft-404 - need to web scrape for keywords. -- GreenC 15:22, 7 April 2025 (UTC)[reply]
They use JS, making web scraping impossible. Trying w3m/lynx clients which appear to return an empty result when page not found. -- GreenC 15:34, 7 April 2025 (UTC)[reply]

Enwiki

  • Checked 969 pages and edited 843 pages. Moved 825 links to a new URL: 2 normal redirects, 823 ruled mapped redirects, Removed 3 {{dead link}}. Added 55 {{dead link}}. Switched 49 |url-status=dead to live. Switched 6 |url-status=live to dead. Added 117 archive URLs (106 Wayback).
Summary: Converted 825 links. Found 273 links unable to convert. Some already had archives, 117 new archives and 55 {{dead link}}

IABot DB

  • Processed about 2,400 unique links updated about 700

 Done -- GreenC 21:26, 7 April 2025 (UTC)[reply]

Could you post a list of ones that werent able to convert? If you could sort them into categories (like athletes, news, etc.), I'll see which ones I can convert over manually. Some of them I'll have to keep as archives. Thank you! MrLinkinPark333 (talk) 00:04, 8 April 2025 (UTC)[reply]
Wikipedia:Link rot/Cases/www.olympic.org.nz - the first 20 or so are sorted out of order because they start with https -- GreenC 01:53, 8 April 2025 (UTC)[reply]

equipu.cl

[edit]

This domain apparently expired, I am not sure how many links are to "equipu.cl" and how to replace them. Jo-Jo Eumerus (talk) 10:13, 2 April 2025 (UTC)[reply]

22 pages. Will do. -- GreenC 18:39, 5 April 2025 (UTC)[reply]

Enwiki

  • Checked 22 pages and edited 20 pages. Added 3 {{dead link}}. Switched 2 |url-status=live to dead. Added 16 archive URLs (16 Wayback).

IABot DB

  • Processed about 50 unique links

 Done -- GreenC 22:39, 7 April 2025 (UTC)[reply]

tfaw.com

[edit]

TFAW (Things From Another World) announced that it is shutting down with its website (https://www.tfaw.com/) going dark on April 30. It's a comics e-commerce site with some amount of blog posts; only about ~60 articles although it looks like a lot of the older blogs from the site (like from before 2010) are already dead. Sariel Xilo (talk) 22:12, 2 April 2025 (UTC)[reply]

Enwiki

  • Checked 61 pages and edited 25 pages. Added 2 {{dead link}}. Switched 1 |url-status=live to dead. Added 23 archive URLs (14 Wayback).
Looks like most were previously archived

IABot DB

  • Processed and updated 94 unique links

 Done -- GreenC 22:59, 7 April 2025 (UTC)[reply]

voanews.com

[edit]

Voice of America - check site integrity. 8,800 pages. -- GreenC 22:00, 6 April 2025 (UTC)[reply]

Enwiki

IABot DB

  • Checked about 25,000 links and updated about 8,000

 Done -- GreenC 22:57, 9 April 2025 (UTC)[reply]

defense.gov

[edit]

6,400 pages. -- GreenC 22:50, 6 April 2025 (UTC)[reply]

Enwiki

IABot DB

  • Checked about 6,000 links and updated about 2,700

 Done -- GreenC 02:48, 10 April 2025 (UTC)[reply]

prola.aps.org

[edit]

prola.aps.org was formerly used for serving articles from journals of the American Physical Society. It's been redirecting since about 2015 but is currently giving a 502 error.

Most links are of the form http://prola.aps.org/abstract/<journal>/v<volume>/i<issue>/p<page>_<article>. The new URL structure drops the issue number. The first article on the page gets a link with no article suffix, whereas the second article on the page receives a ".2" suffix. Journals now have a short code and a long code.

The page may be non-numeric, e.g. "A171" or "R17".

Some articles have an "e" number instead of a page number, sometimes with a trailing slash, this is treated as a page number in the new system, without the "e" prefix or slash.

Some old URLs have a query string, which can be discarded.

Some editors linked to the PDF instead of the abstract page. For paywalled articles, the PDF link is an unhelpful error message and should be avoided. For open access articles, it does work, with /pdf/ in the URL instead of /abstract/ like in the old system.

We have three links to /pagegif/, a feature which apparently no longer exists. These should go to the abstract or PDF.

PROLA code New short code Long code
PR pr PhysRev
PRA pra PhysRevA
PRB prb PhysRevB
PRC prc PhysRevC
PRD prd PhysRevD
PRE pre PhysRevE
PRI pri PhysRevSeriesI
PRL prl PhysRevLett
RMP rmp RevModPhys

Examples:

Tim Starling (talk) 00:42, 7 April 2025 (UTC)[reply]

Redirecting since 2015. There is high probability the redirect mappings are stored in the Wayback Machine:
It's only 96 pages. I'll retrieve these, and post the map before uploading for your review. Given the small scale and complexity I don't want to program too much. -- GreenC 03:28, 7 April 2025 (UTC)[reply]

Tim Starling: Can you take a look? Wikipedia:Link rot/Cases/prola.aps.org - I'd rather fix semi-manually than coding complex rules. I can just make these changes, or if you want make adjustments on that page and I'll incorporate before uploading. -- GreenC 18:00, 9 April 2025 (UTC)[reply]

Give me a day or so, I can fix your set B and C URLs. You want them in the same format as set A? -- Tim Starling (talk) 02:48, 11 April 2025 (UTC)[reply]
Sure, however you like. I guess ideally 2 columns, the original on left and new on right. Don't need page names. -- GreenC 06:35, 11 April 2025 (UTC)[reply]
GreenC: Done. I used vim regexes. I confirmed that all the destination links work. -- Tim Starling (talk) 02:03, 12 April 2025 (UTC)[reply]
User:Tim Starling, most are fixed I found another 8 that were missed the first run: Wikipedia:Link rot/Cases/prola.aps.org#Set D - could you regex these? -- GreenC 00:03, 13 April 2025 (UTC)[reply]
Done Tim Starling (talk) 11:03, 13 April 2025 (UTC)[reply]
Alright, it appears to be complete. Thanks for the conversion help. -- GreenC 16:20, 13 April 2025 (UTC)[reply]

avclub.com/tvclub

[edit]

These links with /tvclub/ do not redirect to their new locations, such as this going here for The Gayle Tales. They cant be converted due to the new page ids. ~1500 pages with some already archived. Thank you. MrLinkinPark333 (talk) 00:43, 8 April 2025 (UTC)[reply]

Can get there in 4 steps: step 1 -> step 2 -> step 3 -> step 4 ie. a ghost redirect with a redirect mapping in the last step. Will see how many it works. -- GreenC 01:34, 10 April 2025 (UTC)[reply]
It required running slowly to avoid detection and a block by CloudFlare. I also developed a new technique for ghostarchive detection that makes it easier to setup and better results. -- GreenC 15:30, 10 April 2025 (UTC)[reply]

Enwiki

IABot DB

  • Checked and updated about 2,500 unique links

 Done -- GreenC 06:28, 11 April 2025 (UTC)[reply]

abc.net.au/misc

[edit]

abc.net.au/*/txt/ and abc.net.au/*/transcripts/

Inspired by the above abc.net.au item, I've just recalled once again that all these old links are dead and need to be archived. They either come up with "Page not found" errors (like this) or "Page archived" errors like this one or that one, and InternetArchiveBot doesn't seem to realise they're dead lihnks. I was going to provide a list of linksearch texts to use, but it'd get very long very quickly and I'm not sure how much help it would be. Any assistance archiving these links would be appreciated. Graham87 (talk) 02:56, 8 April 2025 (UTC)[reply]

541 pages -- GreenC 03:54, 8 April 2025 (UTC)[reply]

Enwiki

  • Checked 541 pages and edited 370 pages. Added 5 {{dead link}}. Switched 47 |url-status=live to dead. Added 357 archive URLs (327 Wayback). Changed 12 citation metadata.

IABot DB

  • Checked and updated 625 unique links that propagate through 300+ wikis

 Done -- GreenC 21:23, 10 April 2025 (UTC)[reply]

tcm.com

[edit]

Please check the site integrity for https://www.tcm.com/, since some of the database pages like the one on Mad Max: Fury Road can redirect to a 404 error. 12,928 pages. Lord Sjones23 (talk - contributions) 03:07, 9 April 2025 (UTC)[reply]

Enwiki

Pass 1 (00001-05000): Checked 5,000 pages and edited 3,938 pages. Moved 4,928 links to a new URL: 54 normal redirects, 4,868 ruled mapped redirects, 6 ghost mapped redirects, Resolved 578 soft-404s. Removed 9 {{dead link}}. Added 71 {{dead link}}. Switched 158 |url-status=dead to live. Switched 20 |url-status=live to dead. Added 93 archive URLs (81 Wayback). Changed 1,636 citation metadata.
Pass 2 (05001-10000): Checked 5,000 pages and edited 4,009 pages. Moved 5,009 links to a new URL: 45 normal redirects, 4,946 ruled mapped redirects, 18 ghost mapped redirects, Resolved 499 soft-404s. Removed 15 {{dead link}}. Added 83 {{dead link}}. Switched 188 |url-status=dead to live. Switched 15 |url-status=live to dead. Added 90 archive URLs (89 Wayback). Changed 1,535 citation metadata.
Pass 3 (10001-13919): Checked 3,919 pages and edited 3,129 pages. Moved 3,851 links to a new URL: 58 normal redirects, 3,786 ruled mapped redirects, 7 ghost mapped redirects, Resolved 396 soft-404s. Removed 3 {{dead link}}. Added 62 {{dead link}}. Switched 115 |url-status=dead to live. Switched 12 |url-status=live to dead. Added 86 archive URLs (79 Wayback). Changed 1,201 citation metadata.


IABot DB

  • Checked 25,400 unique links and updated 10,100 which propagate through 300+ wikis

 Done -- GreenC 21:56, 12 April 2025 (UTC)[reply]

army.mil

[edit]

17,677 pages -- GreenC 01:23, 10 April 2025 (UTC)[reply]

Enwiki

Pass 1 (00001-03000): Checked 3,000 pages and edited 1,469 pages. Moved 594 links to a new URL: 81 normal redirects, 513 ruled mapped redirects, Resolved 141 soft-404s. Removed 2 {{dead link}}. Added 80 {{dead link}}. Switched 69 |url-status=dead to live. Switched 141 |url-status=live to dead. Added 1,697 archive URLs (1,566 Wayback). Changed 115 citation metadata.
Pass 2 (03001-10000): Checked 7,000 pages and edited 3,392 pages. Moved 1,410 links to a new URL: 140 normal redirects, 1,270 ruled mapped redirects, Resolved 287 soft-404s. Removed 3 {{dead link}}. Added 240 {{dead link}}. Switched 216 |url-status=dead to live. Switched 403 |url-status=live to dead. Added 4,175 archive URLs (3,786 Wayback). Changed 245 citation metadata.
Pass 3 (10001-17084): Checked 7,085 pages and edited 3,385 pages. Moved 1,421 links to a new URL: 212 normal redirects, 1,209 ruled mapped redirects, Resolved 361 soft-404s. Removed 3 {{dead link}}. Added 232 {{dead link}}. Switched 171 |url-status=dead to live. Switched 406 |url-status=live to dead. Added 3,770 archive URLs (3,091 Wayback). Changed 269 citation metadata.


IABot DB

Checked 27,500 unique links and updated 19,000 which propagate through 300+ wikis

 Done -- GreenC 15:24, 15 April 2025 (UTC)[reply]

[edit]

20,198 -- GreenC 01:24, 10 April 2025 (UTC)[reply]

Enwiki

Pass 1 (00001-03000): Checked 3,000 pages and edited 1,202 pages. Moved 344 links to a new URL: 127 normal redirects, 217 ruled mapped redirects, Resolved 499 soft-404s. Added 123 {{dead link}}. Switched 20 |url-status=dead to live. Switched 256 |url-status=live to dead. Added 1,688 archive URLs (1,511 Wayback). Changed 16 citation metadata.
Pass 2 (03001-10000): Checked 7,001 pages and edited 2,589 pages. Moved 744 links to a new URL: 199 normal redirects, 545 ruled mapped redirects, Resolved 1,194 soft-404s. Removed 1 {{dead link}}. Added 348 {{dead link}}. Switched 50 |url-status=dead to live. Switched 543 |url-status=live to dead. Added 3,607 archive URLs (2,941 Wayback). Changed 25 citation metadata.
Pass 3 (10001-20044): Checked 10,046 pages and edited 3,635 pages. Moved 1,110 links to a new URL: 300 normal redirects, 810 ruled mapped redirects, Resolved 1,935 soft-404s. Removed 2 {{dead link}}. Added 388 {{dead link}}. Switched 61 |url-status=dead to live. Switched 764 |url-status=live to dead. Added 5,013 archive URLs (4,453 Wayback). Changed 36 citation metadata.

IABot DB

  • Checked 39,865 unique links and updated 28,188 which propagate through 300+ wikis

 Done -- GreenC 16:20, 19 April 2025 (UTC)[reply]

enciklopedija.hr

[edit]

Recently, Miroslav Krleža Institute of Lexicography shut down their ASP engine for https://enciklopedija.hr, so we need the following changed

Natuknica.aspx?ID= → clanak/
natuknica.aspx?ID= → clanak/
Natuknica.aspx?id= → clanak/
natuknica.aspx?id= → clanak/

So 

https://www.enciklopedija.hr/Natuknica.aspx?ID=37178
https://www.enciklopedija.hr/natuknica.aspx?ID=37178
https://www.enciklopedija.hr/Natuknica.aspx?id=37178
https://www.enciklopedija.hr/natuknica.aspx?id=37178

become 

https://www.enciklopedija.hr/clanak/37178

While at it, please also change http:// to https:// 

http://www.enciklopedija.hr/Natuknica.aspx?ID=37178
https://www.enciklopedija.hr/clanak/37178

That should be 814 articles. Make sure the archived URLs are not changed, i. e. there's no slash before http, as in the search regex above. Ponor (talk) 11:38, 10 April 2025 (UTC)[reply]

Will do. -- GreenC 19:46, 10 April 2025 (UTC)[reply]

Enwiki

IABot DB

  • Checked 10,700 unique links and updated 10,642 which propagate to 300+ wikis

 Done -- GreenC 18:36, 20 April 2025 (UTC)[reply]

bbfc.co.uk

[edit]

Since this site has some dead links and redirects in citations, a link check would be necessary. 6,841 articles. Lord Sjones23 (talk - contributions) 23:07, 11 April 2025 (UTC)[reply]

Lord Sjones23: There are tons of unmapped redirects. Like this (dead) is now this (I think). The site admin/contractors never did the critical redirect mapping step after changing the content management system. The result is going to be lots of dead links with archive URLs. No traffic going to their site globally across 300 wikis that receive billions of clicks yearly. Want to drop them an email? Natasha Kaplinsky is the current President. -- GreenC 06:48, 24 April 2025 (UTC)[reply]

Enwiki

  • Checked 6,885 pages and edited 3,874 pages. Moved 43 links to a new URL: 43 normal redirects, Added 462 {{dead link}}. Switched 1 |url-status=dead to live. Switched 1,308 |url-status=live to dead. Added 3,029 archive URLs (2,428 Wayback). Changed 333 citation metadata.

IABot DB

  • Checked about 15,000 URLs and updated 11,500 which propagate to 300+ wikis

 Done -- GreenC 19:43, 25 April 2025 (UTC)[reply]

dieselpunks.org

[edit]

The domain dieselpunks.org has been usurped and all links (33 articles) now redirect to some shady Indonesian online slot game website rivetnetworks.com. 85.76.128.167 (talk) 11:19, 12 April 2025 (UTC)[reply]

 Done in WP:JUDI batch #27 -- GreenC 15:23, 5 May 2025 (UTC)[reply]

eca.state.gov

[edit]

The Bureau of Educational and Cultural Affairs is curtailed. The website is dead as of Friday April 11 2025. United States cultural exchange programs are dead? The Fulbright Scholarship is dead. -- GreenC 02:31, 15 April 2025 (UTC)[reply]

Site back online, under new management. Will check it out for removed pages. Only 112 pages -- GreenC 19:47, 25 April 2025 (UTC)[reply]

Enwiki

  • Checked 112 pages and edited 62 pages. Moved 19 links to a new URL: 19 normal redirects, Resolved 12 soft-404s. Added 3 {{dead link}}. Switched 2 |url-status=dead to live. Switched 4 |url-status=live to dead. Added 24 archive URLs (19 Wayback). Changed 53 citation metadata.

IABot DB

  • Checked about 200 URLS and updated 96

 Done -- GreenC 22:55, 25 April 2025 (UTC)[reply]

ngdc.noaa.gov

[edit]

1,269 pages

Also here to notify about the impending death of https://www.ngdc.noaa.gov/hazard/eq-intensity.shtml WFUM🔥🌪️ (talk) 05:18, 15 April 2025 (UTC)[reply]

I believe all ngdc.noaa.gov links are now at ncei.noaa.gov, although not necessarily with the same URL afterwards. WFUM🔥🌪️ (talk) 16:24, 15 April 2025 (UTC)[reply]
WFUM, if you come across any patterns that could be used; often websites have information in the old URL that can be used to create a new URL. -- GreenC 03:21, 16 April 2025 (UTC)[reply]
There's a very weird situation going on, as the main NGDC site redirect to NCEI but some things (the one I can find is the tsunami runup database) are still located on NGDC (although they can still be found on NCEI just at diff urls) (https://www.ngdc.noaa.gov/hazel/view/hazards/tsunami/runup-more-info/6847 has one but https://www.ncei.noaa.gov/hazel/view/hazards/tsunami/runup-more-info/6847 has nothing). Thus, I believe the 1,269 pages have many false positives, and the request potentially should be limited to the original link I proposed yesterday for now (with maybe even adding /struts at the end; this request was aimed to primarily cull the earthquake/tsunami database issue.) However, most cases of the tsunami database cites being used are search results from that database, which will be very difficult to map ([16] goes to [17]). All the variable names are different, because I believe they changed from a "nndc/struts" search system to the Hazel searching system. Same case for earthquakes (old: [18] (wow this is daunting) to new: [19]). I believe this will be a "if you see an old link fix it" type scenario unless you can somehow figure out a systematic approach. WFUM🔥🌪️ (talk) 04:27, 16 April 2025 (UTC)[reply]
I did a standard check and replaced dead links with archive URLs, resolved redirects, and checked for soft404s. -- GreenC 03:22, 26 April 2025 (UTC)[reply]

Enwiki

IABot DB

  • Checked about 5,000 URLs and fixed 3,700 which propagate to 300+ wikis

 Done -- GreenC 14:55, 26 April 2025 (UTC)[reply]

Four RCCs

[edit]

All cites of [20], [21], [22], and [23] need to be marked as dead. I believe there is no alternate location for this data. WFUM🔥🌪️ (talk) 20:10, 17 April 2025 (UTC)[reply]

Because there are so few pages and links I went ahead and set the domains to permadead in the IABot database which should take care of most of it. -- GreenC 15:06, 26 April 2025 (UTC)[reply]

srcc.tamu.edu

[edit]

0 pages

sercc.com

[edit]

30 pages

hprcc.unl.edu

[edit]

31 pages

mrcc.purdue.edu

[edit]

5 pages


 Done -- GreenC 15:06, 26 April 2025 (UTC)[reply]

covid.gov

[edit]

Site has been hijacked(?). Appears to be a propaganda outlet for covid conspiracy theories - probably should be usurped. -- GreenC 19:21, 18 April 2025 (UTC)[reply]

2 pages on Enwiki. Need to scrub IABot. -- GreenC 19:22, 18 April 2025 (UTC)[reply]
yea Gladcape2013 (talk) 00:10, 19 April 2025 (UTC)[reply]
It is official the federal government has acquired a lab week as the issue on coronavirus Gladcape2013 (talk) 04:03, 19 April 2025 (UTC)[reply]
leak* Gladcape2013 (talk) 04:04, 19 April 2025 (UTC)[reply]

Enwiki

  • No pages

IABot DB

  • 24 links TBD

Similar to above changed to domain to permadead in the IABot database. Also added to the usurp list at WP:JUDI so the url-status is updated on enwiki. -- GreenC 15:09, 26 April 2025 (UTC)[reply]

 Done

archive.fiba.com

[edit]

This website now redirects to fiba.basketball but does not reirect to the new links.They can't be converted either due to the new strings (such as here to there for Madagascar). Some of these links have already been archived. ~3900 pages. Thanks! MrLinkinPark333 (talk) 00:35, 19 April 2025 (UTC)[reply]

Did you request FIBA before? I recall generating a lot of archive.fiba.com links in 2022 and 2023, the last time they moved URLs (Special:Diff/1088207822/1088292106 and Special:Diff/1168750626/1173686109). Looks like they moved again, and again neglected to create redirect mappings, this time unrecoverable due to different domain, path and IDs. SEO is a thing. -- GreenC 15:44, 26 April 2025 (UTC)[reply]
Another user made that request. I requested archives for archive.usab.com around the same time back in 2023. MrLinkinPark333 (talk) 18:32, 26 April 2025 (UTC)[reply]
OK. Wish websites could redirect map. "The old refrain". -- GreenC 20:25, 26 April 2025 (UTC)[reply]
This will take a while. The link density per page is high, Wayback API is running slow, some other issues specific to the domain. -- GreenC 04:07, 27 April 2025 (UTC)[reply]
The bot has a decision tree which URLs move through as it tests for status and archive availability. The number of possible paths through the tree are countless. Ideally it's a short path but some domains don't behave well and it can take a long time to wind through and come to a final decision. I was able to tweak certain areas to speed it up where it kept going down a path that hit some lengthy sleep-retry cycles. -- GreenC 16:20, 28 April 2025 (UTC)[reply]

Enwiki

  • Checked 3,907 pages and edited 3,764 pages. Added 2,303 {{dead link}}. Switched 108 |url-status=live to dead. Added 14,565 archive URLs (13,536 Wayback). Changed 138 citation metadata.

IABot DB

  • Checked 23,600 unique URLs and update the same which propagate through 300+ wikis

 Done -- GreenC 01:55, 29 April 2025 (UTC)[reply]

moviegalleri.net

[edit]

The site has lost all its pre-2025 archives. Once mainly a poster hosting website, it no longer does. The files using this as source need to be updated. Kailash29792 (talk) 16:16, 21 April 2025 (UTC)[reply]

243 pages

Enwiki

  • Checked 242 pages and edited 229 pages. Resolved 5 soft-404s. Added 29 {{dead link}}. Switched 49 |url-status=live to dead. Added 155 archive URLs (152 Wayback). Changed 21 citation metadata.

IABot DB

  • Checked about 150 unique URLs and updated propagate through 300+ wikis

 Done -- GreenC 19:56, 26 April 2025 (UTC)[reply]

gamasutra.com

[edit]

This website is now located at gamedeveloper.com. Unfortunately, old links dont redirect like here to there for Fire and Darkness. If ghost redirects can be found, that would be great. ~4700 articles.Thanks! MrLinkinPark333 (talk) 19:15, 23 April 2025 (UTC)[reply]

I made a redirect map: 

           mapredirectTable[&"https://www.gamedeveloper.com/business/{x}"] = 1
           mapredirectTable[&"https://www.gamedeveloper.com/game-platforms/{x}"] = 1
           mapredirectTable[&"https://www.gamedeveloper.com/design/{x}"] = 1
           mapredirectTable[&"https://www.gamedeveloper.com/audio/{x}"] = 1
           mapredirectTable[&"https://www.gamedeveloper.com/press-release/{x}"] = 1
           mapredirectTable[&"https://www.gamedeveloper.com/programming/{x}"] = 1
           mapredirectTable[&"https://www.gamedeveloper.com/production/{x}"] = 1
           mapredirectTable[&"https://www.gamedeveloper.com/marketing/{x}"] = 1
           mapredirectTable[&"https://www.gamedeveloper.com/console/{x}"] = 1

Each URL is tested against these possibilities. It works about half the time. Sometimes there are small changes for example A_view_from_the_directors_chair_of_Assassins_Creed_Origins.php becomes a-view-from-the-director-s-chair-of-i-assassin-s-creed-origins (change "Assassins" to "assasin-s"). Or Epic_is_suing_a_Fortnite_user_experience_tester_over_Chapter_2_leaks.php becomes epic-is-suing-a-i-fortnite-i-user-experience-tester-over-chapter-2-leaks. The extra "-i-" is because the title of the page contains italics (!) like you might do in HTML <i> but pseudo-encoded directly into the URL. The s rule can can be checked for by converting any word that ends in "s_" to "s-s-" (Noahs_Ark becomes noah-s-ark), but sometimes only some of the words have this. Similarly there are abbreviations like "_QR_" becomes "-q-r-", and rule is applied inconsistently, one URL had 3 abbreviations but only one of them had this rule (2^3 = 8 possibilities). Another problem is many of the old URLs have a truncated version of the article title, the new URLs have the full title. I know how to solve for this (inferred mapped redirects) and can give it a try. -- GreenC 16:04, 29 April 2025 (UTC)[reply]

I found solutions for these problems. It's deploying every feature the bot has (all of this and this), and then some. Runs very slow but good results. -- GreenC 18:26, 30 April 2025 (UTC)[reply]
Redid core functions for 'inferred mapped redirects' and 'ruled inferred mapped redirects', which will be applicable for future domains. This was a great test case domain. -- GreenC 23:04, 1 May 2025 (UTC)[reply]

Enwiki

IABot DB

  • Checked and updated about 10,000 unique links which propagate through 300+ wikis

 Done -- GreenC 15:00, 3 May 2025 (UTC)[reply]

desimartini.com

[edit]

Desimartini. No longer active. Kailash29792 (talk) 02:28, 24 April 2025 (UTC)[reply]

249 pages

Enwiki

  • Checked 260 pages and edited 251 pages. Added 20 {{dead link}}. Switched 99 |url-status=live to dead. Added 145 archive URLs (139 Wayback). Changed 49 citation metadata.

IABot DB

  • Checked 359 unique URLs and updated about the same.

 Done -- GreenC 22:20, 26 April 2025 (UTC)[reply]

tv-ark.org.uk

[edit]

Usurped, main page redirects to advertisement for payday loans. 428 links according to Special:LinkSearch. 2A00:807:D3:B2CD:1D64:EE5:ECA4:CA80 (talk) 09:00, 25 April 2025 (UTC)[reply]

 Done in WP:JUDI batch #27 -- GreenC 15:24, 5 May 2025 (UTC)[reply]
Noting that much content would be at tvark.org. This site has spent a lot of time unavailable over the years. Sammi Brie (she/her · t · c) 15:43, 13 June 2025 (UTC)[reply]
True. For example this is now here. There is no obvious way to make the change because there are many sites with grandstand in the URL. This is a manual job for anyone who wants to take it on. Send me a map of old -> new URLs I can make the changes via bot. -- GreenC 16:05, 13 June 2025 (UTC)[reply]

edition.cnn.com

[edit]

CNN seems to have quietly deleted (?) the edition.cnn.com domain, as attempting to go to any source that links it gives my browser an error saying it redirected too many times. One example: https://edition.cnn.com/TRANSCRIPTS/0707/13/ng.01.html is still listed as live at Chris Benoit double-murder and suicide, while other CNN links such as https://www.cnn.com/2007/US/07/17/wrestler.murder/index.html work fine. There may be a way to replace these links, but I haven't found it in my brief research. wizzito | say hello! 09:10, 27 April 2025 (UTC)[reply]

I did some more searching and found that actually, the more recent edition.cnn.com links are live, such as https://edition.cnn.com/2016/12/29/news/donald-trump-golf-courses/index.html at Donald Trump. It seems to be the older links, from the 90s and 2000s, that are having this problem, but not all of them as well?
Seems to affect both transcripts and non-transcripts alike. What a clusterfuck. wizzito | say hello! 09:23, 27 April 2025 (UTC)[reply]
It might be only edition.cnn.com/TRANSCRIPTS/* and edition.cnn.com/US/* links that are repeatedly redirecting, based on these few links. wizzito | say hello! 09:27, 27 April 2025 (UTC)[reply]
It looks like some of the pages were removed (example) and now those pages have a configuration error (redirect loop). It's 600 pages limiting to TRANSCRIPTS and US at edition.cnn.com. But there are others like TECH (example). More likely 1661 pages. This assumes uppercase and doesn't include the possibility of /YYYY/KEYTERM like Bill Clinton URL. Maybe the best approach is check all edition.cnn.com to be safe (22,400 pages) and add some special code looking for the redirect loop, otherwise a normal check for dead links. -- GreenC 16:40, 27 April 2025 (UTC)[reply]
Good idea, but that's a lot of pages to check. If your bot can do it, though, that would be fine. wizzito | say hello! 18:24, 28 April 2025 (UTC)[reply]
Discovery: I managed to find the missing Lady Gaga transcript at https://transcripts.cnn.com/show/lkl/date/2010-06-01/segment/01. Looks like the most important parts of the link are the date (1006/01 = 2010-06-01), show (lkl = Larry King Live) and segment (01). We could remap the transcripts at least using this. wizzito | say hello! 18:39, 28 April 2025 (UTC)[reply]
That date pattern was being used in the 1990s, ancient. I sifted through them a bit but couldn't find anything additional. -- GreenC 01:11, 29 April 2025 (UTC)[reply]
A simple rule for edition.cnn.com/TRANSCRIPTS: Convert this to that then redirects here. -- GreenC 22:03, 3 May 2025 (UTC)[reply]

Enwiki

Pass 1 (00001-03000): Checked 3,000 pages and edited 1,408 pages. Moved 1,200 links to a new URL: 921 normal redirects, 168 ruled mapped redirects, 111 ghost mapped redirects, Resolved 26 soft-404s. Removed 1 {{dead link}}. Added 35 {{dead link}}. Switched 24 |url-status=dead to live. Switched 122 |url-status=live to dead. Added 342 archive URLs (292 Wayback). Changed 213 citation metadata.
Pass 2 (03001-12000): Checked 9,001 pages and edited 3,613 pages. Moved 3,214 links to a new URL: 2,642 normal redirects, 509 ruled mapped redirects, 63 ghost mapped redirects, Resolved 72 soft-404s. Added 84 {{dead link}}. Switched 53 |url-status=dead to live. Switched 219 |url-status=live to dead. Added 679 archive URLs (601 Wayback). Changed 670 citation metadata.
Pass 3 (12001-22166): Checked 10,167 pages and edited 3,988 pages. Moved 3,484 links to a new URL: 2,870 normal redirects, 495 ruled mapped redirects, 119 ghost mapped redirects, Resolved 104 soft-404s. Added 109 {{dead link}}. Switched 60 |url-status=dead to live. Switched 258 |url-status=live to dead. Added 746 archive URLs (673 Wayback). Changed 735 citation metadata.

IABot DB

  • Checked over 52,000 unique links and updated 7,354

 Done -- GreenC 01:27, 7 May 2025 (UTC)[reply]

digital.olivesoftware.com

[edit]

Nothing special here sadly, just need them all rescued or marked as dead. Only about 385 cases that I can find, with a lot already archived. Chew(V • T • E) 22:32, 27 April 2025 (UTC)[reply]

Actually a somewhat difficult site to retrieve Wayback links, due to their pages being almost entirely images, and there are some malformed retrievals in the Wayback Machine. Not confident all the 188 {{dead link}} added are accurate but most should be. When I first ran it, almost all were tagged as dead link, then I made some adjustments and got the results below. -- GreenC 15:56, 7 May 2025 (UTC)[reply]

Enwiki

  • Checked 389 pages and edited 361 pages. Added 188 {{dead link}}. Switched 42 |url-status=live to dead. Added 1,452 archive URLs (1,445 Wayback).

IABot DB

 Done -- GreenC 05:08, 8 May 2025 (UTC)[reply]

classification.gov.au

[edit]

Please check for any potential dead links and/or redirects on the OFLC website (which was shut down not that long ago) and the Australian Classification Board's website. 9 links for OFLC and 269 links for ACB. Lord Sjones23 (talk - contributions) 03:52, 29 April 2025 (UTC)[reply]

For oflc.gov.au I set to dead in IABot.org there are so few links -- GreenC 01:34, 7 May 2025 (UTC)[reply]

Enwiki

  • Checked 270 pages and edited 116 pages. Moved 20 links to a new URL: 11 normal redirects, 9 ghost mapped redirects, Added 44 {{dead link}}. Switched 4 |url-status=dead to live. Switched 38 |url-status=live to dead. Added 70 archive URLs (69 Wayback). Changed 96 citation metadata.

IABot DB

  • Checked about 1,100 unique URLs and updated about 750

 Done -- GreenC 05:07, 8 May 2025 (UTC)[reply]

wycombewanderers.co.uk

[edit]

similar to redimps.co.uk - domain no longer active (Wycombe Wanderers F.C. now use the domain wwfc.com) but marked as permalive by IABOT. used on 268 pages. more recent articles can seemingly be fixed by changing domain - [24] as used on 2020–21 Chelsea F.C. season is live at [25] but older ones use a different url format so cant be fixed like this even if still live. Microwave Anarchist (talk) 13:32, 29 April 2025 (UTC)[reply]

  • Odd site. Some URLs can be accessed via bot [26], other URLs it falsely returns 404 [27]. CloudFront is involved. Looks like bot protection misconfiguration, or partial coverage. It seems any URL with "/news/YYYY/month/" is working. So what I can do is for those that return 404, if it also has that "news" form, it will assume it's actually 200. I am unable to verify it, so this will be a "Blind URL Move" with the associated hazard of getting it wrong. I'll do spot checks before uploading the diffs. -- GreenC 17:18, 8 May 2025 (UTC)[reply]
  • Another: Given an archive URL like this, extract the date "31 July 2014", and from that build a new URL here that works. This is a inferred mapped redirect. -- GreenC 18:31, 8 May 2025 (UTC)[reply]
    Unfortunately there is a bad combination of factors: 1. They use JavaScript so it's not evident what's being displayed without a headless browser. 2. A headless browser is slow and doesn't work without cookies to get past the cookie acceptance button and that is difficult to setup. 3. They have some unusual bot blocker, that redirects to a "404" (displayed) but actually returns status code 200. The end results is over 400 URLs ending in .aspx that could be converted to a live page, but I can't make it work due to these complications. -- GreenC 20:17, 8 May 2025 (UTC)[reply]

Enwiki

  • Checked 268 pages and edited 222 pages. Moved 347 links to a new URL: 347 ruled mapped redirects, Resolved 426 soft-404s. Added 19 {{dead link}}. Switched 27 |url-status=dead to live. Switched 22 |url-status=live to dead. Added 234 archive URLs (193 Wayback). Changed 17 citation metadata.

IABot DB

  • Checked and updated 821 unique links

 Done -- GreenC 22:45, 8 May 2025 (UTC)[reply]

renatabernal.com

[edit]

Usurped: used to be the website of an artist living in upstate NY, now has been taken over by what looks like a japanese porn company. 66.24.80.198 (talk) 17:42, 30 April 2025 (UTC)[reply]

 Done in WP:JUDI batch #27 -- GreenC 15:24, 5 May 2025 (UTC)[reply]

bhaskar.com

[edit]

Any subdomains of bhaskar.com don't work, like this at Ajay Devgn. Some of the urls without subdomains work, like this at Tariq Umar Khan. But this doesn't work at Jaipur. I request that the subdomains be focused on first. ~3200 overall. Thank you! MrLinkinPark333 (talk) 20:04, 1 May 2025 (UTC)[reply]

It's difficult to check www vs everything else because it ends up being being the same process internally. I'll check them all at one go. -- GreenC 22:51, 8 May 2025 (UTC)[reply]

Enwiki

  • Checked 3,317 pages and edited 1,060 pages. Moved 356 links to a new URL: 336 normal redirects, 20 ghost mapped redirects, Resolved 1,304 soft-404s. Removed 5 {{dead link}}. Added 92 {{dead link}}. Switched 38 |url-status=dead to live. Switched 181 |url-status=live to dead. Added 537 archive URLs (498 Wayback). Changed 91 citation metadata.

IABot DB

  • Checked 6,300 unique links and updated about 2,000 which propagate through 300+ wikis

 Done -- GreenC 04:31, 9 May 2025 (UTC)[reply]

finlex.fi

[edit]

Per thread at top of this page. -- GreenC 01:51, 3 May 2025 (UTC)[reply]

402 pages

This will be done in two passes. -- GreenC 05:52, 9 May 2025 (UTC)[reply]

Enwiki

Pass 1 (001-402): Checked 402 pages and edited 225 pages. Moved 215 links to a new URL: 215 normal redirects, Added 2 {{dead link}}. Switched 49 |url-status=dead to live. Switched 17 |url-status=live to dead. Added 139 archive URLs (137 Wayback).
Pass 2 (001-402): Checked 402 pages and edited 221 pages. Moved 336 links to a new URL: 336 normal redirects, Switched 1 |url-status=dead to live. Changed 6 citation metadata.

IABot DB

  • Checked 3,700 unique URLs and updated 627 which propagate to 300+ wikis

 Done -- GreenC 18:24, 9 May 2025 (UTC)[reply]

portlandtribune.com

[edit]

This website has suddenly removed most of their archives. For example, sports only go up to April 26th of this year. Hopefully this is just a temporary implement, but I request archived link just in case. ~1000. Thank you! MrLinkinPark333 (talk) 00:30, 4 May 2025 (UTC)[reply]

Enwiki

  • Checked 1,017 pages and edited 774 pages. Moved 23 links to a new URL: 1 normal redirects, 22 ghost mapped redirects, Added 102 {{dead link}}. Switched 4 |url-status=dead to live. Switched 225 |url-status=live to dead. Added 663 archive URLs (622 Wayback). Changed 4 citation metadata.

IABot DB

  • Checked 1,335 unique links and updated about the same

 Done -- GreenC 22:18, 9 May 2025 (UTC)[reply]

almasdarnews.com

[edit]

The site has been down for some time and there are quite a few articles that use it. Thanks, David O. Johnson (talk) 03:36, 6 May 2025 (UTC)[reply]

707 pages

Enwiki

  • Checked 711 pages and edited 265 pages. Added 14 {{dead link}}. Switched 303 |url-status=live to dead. Added 330 archive URLs (312 Wayback). Changed 11 citation metadata.

IABot DB

  • Checked and updated about 5,400 unique URLs

 Done -- GreenC 02:06, 10 May 2025 (UTC)[reply]

Appreciate it. David O. Johnson (talk) 02:16, 10 May 2025 (UTC)[reply]

iana.org/root-whois

[edit]

Looks like there used to be redirects from https://www.iana.org/root-whois/$1.htm (also .html) to https://www.iana.org/domains/root/db/$1.html which now go to the index page instead (see .zr, January 28 and .aq, January 29). Thanks! --Nintendofan885T&Cs apply 12:40, 6 May 2025 (UTC)[reply]

212 pages

The example for .zr is a dead link [28] and archive snapshots go to 404 pages. The .aq works. In the case of .zr it will end up adding a {{dead link}} template and leaving the original URL. -- GreenC 22:32, 9 May 2025 (UTC)[reply]

Enwiki

IABot DB

  • Checked and updated 600 unique URLs which propagate through 300+ wikis

 Done -- GreenC 02:59, 10 May 2025 (UTC)[reply]

Vice

[edit]
moved from Wikipedia:AutoWikiBrowser/Tasks

motherboard.vice.com

[edit]

Shouldn't all motherboard.vice.com links be replaced?

So from:

https://motherboard.vice.com/en_us/article/ identifier /articlename

to:

https://www.vice.com/en/article /articlename

So for example if you got this link:

https://motherboard.vice.com/en_us/article/yp3ppm/robert-de-niro-wants-a-dialogue-about-anti-vaxxing-at-tribeca-film-festival

the article is actually located at:

https://www.vice.com/en/article/robert-de-niro-wants-a-dialogue-about-anti-vaxxing-at-tribeca-film-festival

894 results for insource:"motherboard.vice.com"

Polygnotus (talk) 14:58, 9 May 2025 (UTC)[reply]

Interesting... I'll try to do something about that, even though I'm not the most experienced with RegEx... - OpalYosutebito 『talk』 『articles I want to eat』 15:29, 9 May 2025 (UTC)[reply]
Polygnotus, sounds like a job for WP:URLREQ. — Qwerfjkltalk 15:53, 9 May 2025 (UTC)[reply]

897 pages

There are numerous redirect mapping rules:

Everything changed to "www.vice.com/en/article/" .. including other vice.com URLs .. I'll focus on motherboard for now -- GreenC 03:31, 10 May 2025 (UTC)[reply]

Thank you! Polygnotus (talk) 03:42, 10 May 2025 (UTC)[reply]
Enwiki
 Done -- GreenC 16:22, 10 May 2025 (UTC)[reply]

misc.vice.com

[edit]

The subdomains whose content is still hosted on vice.com, but in the root, are sports, munchies, noisey, news, waypoint, thump, broadly, and fightland.

It is unclear to me what happened to the video subdomain. It seems to have disappeared?

There is also a /read/ as you mentioned above (not just on the motherboard subdomain).

https://www.vice.com/read/prolific-music-critic-robert-christgau-knows-what-he-likes-and-hates-v23n07

which moved to:

https://www.vice.com/en/article/prolific-music-critic-robert-christgau-knows-what-he-likes-and-hates-v23n07/

/blog/ also changed to /article/

I searched for insource:/[^(fightland|broadly|thump|video|waypoint|sports|munchies|noisey|news|motherboard)]\.vice\.com/ and I think that was all of 'em.

Polygnotus (talk) 04:47, 10 May 2025 (UTC)[reply]

4,741 pages -- GreenC 05:51, 10 May 2025 (UTC)[reply]
Enwiki
IABot DB
  • Checked about 9,000 unique links (includes motherboard); updated 8,691 which propagate to 300+ wikis
 Done -- GreenC 19:07, 11 May 2025 (UTC)[reply]

i-d.vice.com

[edit]

This is related but different:

It looks like a company called Bedford Media acquired a magazine called i-D from Vice media.

They seem to have relocated to a different domain.

So for example the old URLs looked like this:

https://i-d.vice.com/en/article/qjkakb/how-did-taylor-swift-get-successful

which was moved to:

https://i-d.co/article/how-did-taylor-swift-get-successful/

I haven't done a full investigation but this appears to be related to the fact that Vice Media was in financial trouble at some point. Polygnotus (talk) 04:35, 10 May 2025 (UTC)[reply]

1403 pages Polygnotus (talk) 04:42, 10 May 2025 (UTC)[reply]

Yeah I thought Vice was a gonner, but glad to see they have not only kept their old content accessible (95% anyway), but reorganized the URLs to be consistent, most large sites don't achieve this degree of accuracy. It's unfortunate they somehow got entangled with the Trump clan (Bedford Media). Ironically the Soros Fund Management may have sold it to them. An article from a year ago says many of the old sites like Motherboard will be coming back.[29] If so that could change everything again, depending what they do with the archives. -- GreenC 21:15, 11 May 2025 (UTC)[reply]
https://variety.com/2023/digital/news/karlie-kloss-acquires-id-magazine-vice-media-1235790828/ Kloss supported Hillary Clinton in the 2016 United States presidential election, Joe Biden in the 2020 election, and Kamala Harris in the 2024 election. She and her husband attended the March for Our Lives event in Washington, D.C. in protest of gun violence in March 2018. She is a feminist and has stated that her decision to leave Victoria's Secret was partly motivated by her feminist beliefs. -- Karlie Kloss#Personal life Polygnotus (talk) 04:33, 12 May 2025 (UTC)[reply]
Enwiki
  • Checked 1,404 pages and edited 1,366 pages. Moved 1,426 links to a new URL: 1,426 ruled mapped redirects, Resolved 206 soft-404s. Removed 1 {{dead link}}. Added 8 {{dead link}}. Switched 124 |url-status=dead to live. Switched 32 |url-status=live to dead. Added 139 archive URLs (139 Wayback). Changed 28 citation metadata.
IABot DB
 Done -- GreenC 15:33, 12 May 2025 (UTC)[reply]
Daaaaaang... you're out here doing the lord's work! - OpalYosutebito 『talk』 『articles I want to eat』 04:32, 12 May 2025 (UTC)[reply]
Indeed, the thing God cares most about is the preservation of, and correct linking to, webpages. 666 is not the devils number, 404 is. Polygnotus (talk) 04:34, 12 May 2025 (UTC)[reply]
lol ! GreenC 15:33, 12 May 2025 (UTC)[reply]
There are two things that us Wikipedians find absolutely detestable: 404 links and lost media. Also, the number 4 is unlucky in East Asian cultures, since it's often pronounced similarly to "death" in Chinese and Japanese - OpalYosutebito 『talk』 『articles I want to eat』 01:33, 13 May 2025 (UTC)[reply]
I noticed this when working on International Commerce Centre#Floor count they end up skipping a lot of floors. -- GreenC 16:29, 13 May 2025 (UTC)[reply]

www.vice.com

[edit]

User:Polygnotus: 16,000+ www pages. The first result at Google contains https://www.vice.com/en/article/v7d7j9/google-had-secret-project-to-convince-employees-that-unions-suck which redirects to https://www.vice.com/en/article/google-had-secret-project-to-convince-employees-that-unions-suck/ .. I think we should update. Couple reasons: the redirects may eventually stop working like the misc.vice.com set. Also I found with the misc set sometimes URLs with a non-English language code like "/nl/" may no longer work but when changed to "/en/" works. Some other things like that. Adding new URLs also triggers saves into the Wayback Machine. -- GreenC 05:44, 11 May 2025 (UTC)[reply]

@GreenC I kinda feel guilty for having you do all this work. I agree that relying on redirects is not a good idea, despite them being 301s, because there are just so many that having to change them again would suck. According to Reuters they have some weird deal with a company called "Savage Ventures" but that seems to only apply to the videos. If I dig video.vice.com I see a CNAME of savageplatform.go-vip.net. It is possible that they are still working on bringing the videos back (because you wouldn't use go-vip.net in prod); and if they do there are another 91 that are fixable. Polygnotus (talk) 05:59, 11 May 2025 (UTC)[reply]
There was work finding and building rules but that's not uncommon, vice is in the medium category of difficulty. Beyond that it's the computer doing the work and the rules are now programmed. Getting them now is more accurate than trying to build a redirect map later. For videos, about half of the links in the misc set that are Wayback or dead link or url-status=dead are /video/ or /blog/ .. the rest are pages that no longer exist, or moved to a very different URL with no pattern. -- GreenC 14:00, 11 May 2025 (UTC)[reply]
Enwiki
IABot DB
  • Checked about 20,000 unique URLs and updated 3,282 which propagate through 300+ wikis
 Done -- GreenC 20:24, 13 May 2025 (UTC)[reply]

edge.vice.com

[edit]

Edge cases known via IABot scans somewhere in the 300+ wikis:

  • insource:vice.com insource:([.]|\/)(artofblue|company|eyeforaneye|films|hbo|thecreatorsproject|www2|wwww|thump2|daily|livenation|jp|creators|takemeanywhere|chillie|als|tonic|impact|cookiewall|garage|partners|plus|cutoff|upload-assets|free|assets|amuse|filmschool|images|motherboard-images|video-images|vice-images|noticias|studios|new)[.]vice[.]com/

This is more than the regex can handle before timing out it returns 355. With an SQL query it gets 442 pages on enwiki. -- GreenC 16:06, 13 May 2025 (UTC)[reply]

Enwiki
IABot DB
Checked 684 unique urls and updated 657 which propagate through 300+ wikis
 Done -- GreenC 22:24, 13 May 2025 (UTC)[reply]

vice.com

[edit]

16 pages

Enwiki
IABot DB
  • Checked 11 unique URLs and updated 5
 Done -- GreenC 22:30, 13 May 2025 (UTC)[reply]

rhrp.org.uk

[edit]

Per the discussion at Wikipedia talk:WikiProject UK Railways the Railway Heritage Register Online have revamped their site with a new database without any clear link between them. While they are being fixed manually, would it be possible for a bot to mark links to http://www.ws.rhrp.org.uk/ws/ (the old pattern) as dead and link to the Internet Archive version. The new pattern starts https://ws.rhrp.org.uk/WagonSurvey/ so those links should be left as-is. Thryduulf (talk) 16:09, 9 May 2025 (UTC)[reply]

User:Thryduulf that would be no problem. -- GreenC 16:50, 9 May 2025 (UTC)[reply]
27 pages
There are two Railway heritage Register Online paths that have been moved. In addition to the above wagon pages, there are carriage pages that start http://www.cs.rhrp.org.uk/se/ (old pattern) which have now been replaced by https://cs.rhrp.org.uk/CarriageSurvey/ Geof Sheppard (talk) 17:22, 10 May 2025 (UTC)[reply]

Thryduulf and Geof Sheppard: can you confirm the task? Has anything changed with the websites?

Thanks. -- GreenC 18:19, 26 May 2025 (UTC)[reply]

@GreenC That's correct. The links above are all lead to plain pages rather than anything useful (for some reason) but the websites are live, e.g. https://cs.rhrp.org.uk/CarriageSurvey/displaycarriage.php?Ref=J5WH1AY276U8IOBLEXTG Thryduulf (talk) 19:07, 26 May 2025 (UTC)[reply]

Enwiki

  • Checked 120 pages and edited 107 pages. Added 99 {{dead link}}. Switched 37 |url-status=live to dead. Added 933 archive URLs (933 Wayback).

IABot DB

  • Checked and updated about 850 unique links to propagate through 300+ wikis

 Done -- GreenC 05:37, 27 May 2025 (UTC)[reply]

Thank you. Thryduulf (talk) 09:29, 27 May 2025 (UTC)[reply]

basic.newspapers.com

[edit]

For newspapers.com, some institutions give users under a specific company or institution access to newspapers.com, and the url appears as basic.newspapers.com. When attempting to access this from a device that has access to newspapers.com, it presents the error:

Unauthorized Access Please return to your institution's website or portal and sign in again.

This can be fixed by removing the "basic." from the start of every newspapers.com url that uses the basic subdomain. It causes no issues for computers in those institutions, as the domain automatically redirects them to a basic page. See Jayson Werth as an article that has this issue. The bot would need to run multiple times, to correct any urls that have come up between times, but probably not often at all. Yoblyblob (Talk) :) 18:47, 9 May 2025 (UTC)[reply]

48 pages GreenC 19:25, 9 May 2025 (UTC)[reply]

Enwiki

(ps. I'll think about some way to do this periodically. Need a "perennial requests" reminder page)

Periodic required.

-- GreenC 06:25, 27 May 2025 (UTC)[reply]

Template:Refideas on talk pages

[edit]

I've noticed that many URLs within the {{Refideas}} template ("This template provides a way to tell other editors about potentially useful references that could be used to improve the article.") on article talk pages are broken. Is it possible for a bot to check all 24,250 talk pages and add archived versions of these URLs if needed? I'm not sure if this is feasible, since the bot would need to avoid altering any URLs outside of the Refideas template. 87.95.243.221 (talk) 16:46, 12 May 2025 (UTC)[reply]

This is a good idea. It's pretty far outside the architecture of the bot. As you say it would need to ignore everything on the page except the template, and there is no mechanism. To program it would be a lot of trial and error, and adding a lot of contingency code to the bot which would only ever be used for this one thing. I did spend time thinking to come up with a clever solution but every pathway ends up being a mess of work and time.  Not done but not forgotten. -- GreenC 17:40, 26 May 2025 (UTC)[reply]

citeftp

[edit]

Project to convert ftp:// links to {{Cite FTP}} template. 5,323 pages.

See Template talk:Cite FTP#Conversion process for how it works and the results. -- GreenC 02:29, 21 May 2025 (UTC)[reply]

 Done -- GreenC 16:14, 28 May 2025 (UTC)[reply]

trafficcalming.org

[edit]

Broken reference links found in the Speed bump page. The trafficcalming.org website is currently a dummy page, redirecting all actually dead links. I tried https://iabot.wmcloud.org/index.php?page=runbotsingle and it doesn't fix them. In the Speed bump page, the http://www.trafficcalming.net/speed_humps.htm link is also listed twice in the reference section, one with archive and one isn't. Billyswong (talk) 03:16, 22 May 2025 (UTC)[reply]

1 page -- GreenC 17:31, 26 May 2025 (UTC)[reply]

Repaired manually: Special:Diff/1292144355/1292393595

 Done -- GreenC 18:37, 26 May 2025 (UTC)[reply]

www.openaccessrepository.it

[edit]

About 100 links from {{cite journal}}. From a spot check they seem to all return HTTP 404. The repository seems to have been migrated. I checked a small sample and they were all available at the wayback machine (and also at Internet Archive Scholar). Nemo 07:57, 24 May 2025 (UTC)[reply]

144 pages -- GreenC 17:30, 26 May 2025 (UTC)[reply]

Enwiki

  • Checked 144 pages and edited 142 pages. Added 16 {{dead link}}. Switched 2 |url-status=live to dead. Added 131 archive URLs (131 Wayback).

IABot DB

  • Checked and updated 76 unique links to propagate through 300+ wikis

 Done -- GreenC 19:05, 28 May 2025 (UTC)[reply]

Thanks! Too bad for the dead links, these will need to be removed. (Maybe citation bot will do it.) Nemo 06:52, 29 May 2025 (UTC)[reply]

toonhound.com

[edit]

For years, this was the British animation industry's analogue to Jerry Beck's Cartoon Research and the like. Since last July, an "Index of /" placeholder has become the only site content left; Googling "Toonhound" itself at this writing brings up a host of unrelated results, chief among them Scott Kurtz's official site (toonhoundstudios.com). Whether this ever met WP:RS is for another thread. (H/T @Drmies' rejection summary at Draft:Rocky Hollow [via AFC's Help Desk].) --Slgrandson (How's my egg-throwing coleslaw?) 16:15, 26 May 2025 (UTC)[reply]

202 pages -- GreenC 17:29, 26 May 2025 (UTC)[reply]

Enwiki

  • Checked 203 pages and edited 195 pages. Added 3 {{dead link}}. Switched 16 |url-status=live to dead. Added 229 archive URLs (229 Wayback).

IABot DB

  • Checked and updated 222 unique links to propagate through 300+ wikis

 Done -- GreenC 21:10, 28 May 2025 (UTC)[reply]

nps.gov

[edit]

National Park Service - integrity check. In response to executive order to implement historical negationism ie. "Policing" of negative history.[30]

34,000 pages -- GreenC 19:19, 28 May 2025 (UTC)[reply]

Enwiki

Pass 1 (00001-03000): Checked 3,000 pages and edited 1,850 pages. Moved 1,546 links to a new URL: 542 normal redirects, 955 ruled mapped redirects, 49 ghost mapped redirects, Resolved 177 soft-404s. Removed 7 {{dead link}}. Added 51 {{dead link}}. Switched 93 |url-status=dead to live. Switched 57 |url-status=live to dead. Added 960 archive URLs (957 Wayback).
Pass 2 (03001-09000): Checked 6,000 pages and edited 3,737 pages. Moved 3,161 links to a new URL: 1,210 normal redirects, 1,879 ruled mapped redirects, 72 ghost mapped redirects, Resolved 524 soft-404s. Removed 13 {{dead link}}. Added 89 {{dead link}}. Switched 162 |url-status=dead to live. Switched 195 |url-status=live to dead. Added 2,103 archive URLs (2,091 Wayback).
Pass 3 (09001-17000): Checked 7,996 pages and edited 4,907 pages. Moved 4,192 links to a new URL: 1,765 normal redirects, 2,331 ruled mapped redirects, 96 ghost mapped redirects, Resolved 429 soft-404s. Removed 21 {{dead link}}. Added 139 {{dead link}}. Switched 182 |url-status=dead to live. Switched 246 |url-status=live to dead. Added 2,702 archive URLs (2,557 Wayback).
Pass 4 (17001-25000): Checked 7,999 pages and edited 4,886 pages. Moved 4,217 links to a new URL: 1,749 normal redirects, 2,372 ruled mapped redirects, 96 ghost mapped redirects, Resolved 486 soft-404s. Removed 10 {{dead link}}. Added 113 {{dead link}}. Switched 218 |url-status=dead to live. Switched 253 |url-status=live to dead. Added 2,668 archive URLs (2,332 Wayback).
Pass 5 (25001-33875): Checked 8,873 pages and edited 5,443 pages. Moved 4,515 links to a new URL: 1,758 normal redirects, 2,657 ruled mapped redirects, 100 ghost mapped redirects, Resolved 694 soft-404s. Removed 26 {{dead link}}. Added 128 {{dead link}}. Switched 225 |url-status=dead to live. Switched 218 |url-status=live to dead. Added 3,126 archive URLs (2,618 Wayback).

IABot DB

  • Checked 78,000 unique URLs and updated 43,735 to propagate through 300+ wikis

 Done -- GreenC 01:47, 7 June 2025 (UTC)[reply]

fda.gov

[edit]

Food and Drug Administration - "On Oct. 1, 2024, the FDA began implementing a reorganization impacting many parts of the agency. We are in the process of updating FDA.gov content to reflect these changes".

5,700 pages -- GreenC 19:22, 28 May 2025 (UTC)[reply]

Enwiki

As a matter of disclosure it looks like I messed this up. The site was returning an unusual status code "401" which the bot was interpreting as a dead link - but this was really a bot blocking mechanism many links are actually live. I'm inclined to leave things as they are. Better to have live links treated as dead, than dead links treated as live ie. Internet Archive bot can't process the link when it's bot blocked. -- GreenC 01:59, 30 May 2025 (UTC)[reply]

IABot DB

  • Checked 18,000 unique URLs and updated 8,979 to propagate through 300+ wikis

 Done -- GreenC 14:50, 31 May 2025 (UTC)[reply]

mbda.gov

[edit]

Minority Business Development Agency - integrity check. In response to March 2025 executive order to "Eliminate the agency to the maximum extent allowed by law".

15 pages -- GreenC 19:25, 28 May 2025 (UTC)[reply]

Enwiki

  • Checked 15 pages and edited 10 pages. Moved 1 links to a new URL: 1 ghost mapped redirects, Switched 1 |url-status=live to dead. Added 9 archive URLs (9 Wayback). Changed 1 citation metadata.

IABot DB

  • Checked 18 unique URLs and updated 15 to propagate through 300+ wikis

 Done -- GreenC 02:04, 7 June 2025 (UTC)[reply]

usagm.gov

[edit]

U.S. Agency for Global Media - integrity check. In response to March 2025 executive order to "Eliminate the agency to the maximum extent allowed by law"

47 pages -- GreenC 19:27, 28 May 2025 (UTC)[reply]

Enwiki

  • No changes

IABot DB

  • Checked 78 URLs and updated none

 Done -- GreenC 02:14, 7 June 2025 (UTC)[reply]

fmcs.gov

[edit]

Federal Mediation and Conciliation Service (United States) - integrity check. In response to March 2025 executive order to "Eliminate the agency to the maximum extent allowed by law"

3 pages -- GreenC 19:29, 28 May 2025 (UTC)[reply]

Enwiki

  • Checked 3 pages and edited 3 pages. Resolved 5 soft-404s. Switched 1 |url-status=live to dead. Added 4 archive URLs (4 Wayback).

IABot DB

  • Checked 14 URLs and updated 8 to propagate through 300+ wikis

 Done -- GreenC 02:37, 7 June 2025 (UTC)[reply]

wilsoncenter.org

[edit]

Woodrow Wilson International Center for Scholars - integrity check. In response to March 2025 executive order to "Eliminate the agency to the maximum extent allowed by law"

1,836 pages -- GreenC 19:31, 28 May 2025 (UTC)[reply]
URLs at digitalarchive.wilsoncenter.org (example) are skipped due to "Are you human" block.

Enwiki

IABot DB

  • Checked 2,494 unique URLs and updated 803 to propagate through 300+ wikis

 Done -- GreenC 16:54, 7 June 2025 (UTC)[reply]

usich.gov

[edit]

United States Interagency Council on Homelessness- integrity check. In response to March 2025 executive order to "Eliminate the agency to the maximum extent allowed by law"

28 pages -- GreenC 19:33, 28 May 2025 (UTC)[reply]

Enwiki

  • Checked 28 pages and edited 18 pages. Moved 5 links to a new URL: 5 normal redirects, Added 2 {{dead link}}. Switched 7 |url-status=live to dead. Added 8 archive URLs (6 Wayback). Changed 8 citation metadata.

IABot DB

  • Checked 52 URLs and updated 47 which propagate through 300+ wikis

 Done -- GreenC 03:08, 7 June 2025 (UTC)[reply]

imls.gov

[edit]

Institute of Museum and Library Services - integrity check. In response to March 2025 executive order to "Eliminate the agency to the maximum extent allowed by law"

139 pages -- GreenC 19:35, 28 May 2025 (UTC)[reply]

Enwiki

  • Checked 140 pages and edited 80 pages. Moved 82 links to a new URL: 6 normal redirects, 76 ghost mapped redirects, Added 1 {{dead link}}. Switched 2 |url-status=dead to live. Switched 2 |url-status=live to dead. Added 38 archive URLs (38 Wayback). Changed 8 citation metadata.

IABot DB

  • Checked 216 unique URLs and updated 147 to propagate through 300+ wikis

 Done -- GreenC 19:28, 7 June 2025 (UTC)[reply]

cdfifund.gov

[edit]

Community Development Financial Institutions Fund - integrity check. In response to March 2025 executive order to "Eliminate the agency to the maximum extent allowed by law"

20 pages -- GreenC 19:36, 28 May 2025 (UTC)[reply]

Enwiki

IABot DB

  • Checked 30 URLs and updated 24 to propagate through 300+ wikis

 Done -- GreenC 04:44, 7 June 2025 (UTC)[reply]

neh.gov

[edit]

National Endowment for the Humanities - integrity check. In response to March 2025 executive order to "Eliminate the agency to the maximum extent allowed by law"

949 pages -- GreenC 19:38, 28 May 2025 (UTC)[reply]

Enwiki

  • Checked 951 pages and edited 281 pages. Moved 189 links to a new URL: 182 normal redirects, 7 ghost mapped redirects, Added 12 {{dead link}}. Switched 10 |url-status=dead to live. Switched 8 |url-status=live to dead. Added 110 archive URLs (90 Wayback). Changed 24 citation metadata.

IABot DB

  • Checked 1,258 unique URLs and updated 506 to propagate through 300+ wikis

 Done -- GreenC 22:22, 7 June 2025 (UTC)[reply]

americorps.gov

[edit]

AmeriCorps - 75% staff layoffs in April

28 pages -- GreenC 19:40, 28 May 2025 (UTC)[reply]

Enwiki

  • Checked 28 pages and edited 22 pages. Moved 38 links to a new URL: 38 normal redirects, Resolved 12 soft-404s. Added 1 {{dead link}}. Switched 1 |url-status=dead to live. Added 8 archive URLs (8 Wayback). Changed 4 citation metadata.

IABot DB

  • Checked 45 URLs and updated 25 to propagate through 300+ wikis

 Done -- GreenC 05:00, 7 June 2025 (UTC)[reply]

thestage.co.uk

[edit]

It was requested here that the listed domain underwent restructuring and now all links 404 even though the pages still exist at another URL. Listing it here in lieu of them. there are 3,081 uses of this source in citations. cyberdog958Talk 22:33, 28 May 2025 (UTC)[reply]

User:Cyberdog958 thank you for the referral. This is no problem. According to the IP editor: "we failed to update when we migrated platform". There is not much that can be done to make the links live, but they can be converted to archive links so they are still readable eg. [31] If there is an existing map of old to new the links can be changed easily. -- GreenC 04:45, 29 May 2025 (UTC)[reply]
Hi GreenC
Thanks for your update.
We can create a map, which would of course take some time as each article linked to needs to be found on the current site and added to the map.
Once we have done this, to whom and how should it be submitted please? And in what format? Would csv suffice? Is the Wiki URL / page on which the broken link is found need to be listed, or will the broken link be sufficient? 149.86.35.195 (talk) 07:04, 29 May 2025 (UTC)[reply]
Great! Here are the list of URLs: Wikipedia:Link rot/Cases/thestage.co.uk .. After the map is created, I will make the changes onwiki via bot. Some URLs might have commas, prefer tab separated or space separate is easiest. When you are ready, post the map to the /Cases/ page overwriting current content then notify me.
There is a limitation you should know about. The list of URLs is for English wiki and every other wiki (300+). However, at this time, I can only update English wikipedia .. not the other wikis. In the future I will be able to update the other wikis, but when that will happen is unknown, it could be a long time. Nevertheless I keep a log of potential changes, when that feature becomes available I'll push them through. Most of the links are on English wiki anyway. -- GreenC 17:29, 29 May 2025 (UTC)[reply]
Hi GreenC
I hope all is well in your world!
Before investing in creating a map for so many links, it seems prudent to check that this works as intended.
I have a test file of just 7 links, and forgive me if I am being a bit dense here, I can't see how I can upload it or get it to you. I have visited Wikipedia:Link rot/Cases/thestage.co.uk but don't see how to submit these test updates.
Please advise
With thanks
Simon StageSimon (talk) 12:37, 3 June 2025 (UTC)[reply]
StageSimon, all is well thank you. I'm not sure what interface to Wikipedia you are using, but, there should be a button somewhere that says "Edit this page" or "Edit source". Then you see the first line says:
https://archive.thestage.co.uk
Create a map like this:
https://archive.thestage.co.uk https://newsite.thestage.co.uk
And that's "it" (many times). Recommend copy-paste the entire list to your local computer and create the map there with your local tools, and when ready copy-paste the entire list back into this page using the Edit button again. Hope that helps any questions let me know. -- GreenC 18:01, 3 June 2025 (UTC)[reply]
Hi
I am sorry but I still don't understand the mapping format. Your "Create a map like this:" above doesn't seem to explain what should be pasted back in (other than the new target links)
Are you saying that the order of the URLs in the link rot page is tied to the articles, so it's the order of the links that relates back to the wiki entry? I don't otherwise how it can be discerned.
As an example, I want
https://www.thestage.co.uk/features/2017/edinburgh-adelaide-fringe-holden-street-theatres-award
to now go to
https://www.thestage.co.uk/features/from-edinburgh-to-adelaide-the-prize-taking-shows-down-under
Is it just a case that where it appears in the list will be enough to tie it back to the wiki page?
Thanks for your patience with me!
Simon 62.232.21.50 (talk) 13:05, 4 June 2025 (UTC)[reply]
Each line of the map look like this: <old URL>[SPACE]<new URL>
It is mapping the old url to the new url.
For example: https://oldsite.com https://newsite.com
That is all. Don't worry about how lines are ordered or what page the link was found, the bot will take care of it. — GreenC 17:09, 4 June 2025 (UTC)[reply]

ω Awaiting map -- GreenC 19:42, 7 June 2025 (UTC)[reply]

Hi GreenC
The map is not yet built - it will take quite some time as there's no pattern - so each new url will need to be manually found.
Can I test this by just uploading 7 test URLs - if so can I just add those, or do I need to include them in the whole list and re-paste that? Clearly I do not want to disturb all the other links, be they correct or incorrect.
You've been so helpful, I really appreciate it.
Simon 149.86.35.195 (talk) 09:31, 8 June 2025 (UTC)[reply]
Take your time this kind of work can take a long time, particularly if it's all manual! There is always Amazon Mechanical Turk. You can change that page anyway you like. — GreenC 20:32, 9 June 2025 (UTC)[reply]
Hi
I uploaded 7 test URL updates this morning (say 7 hours ago) - none have updated yet.
Either the bot is very busy or I did it wrong.
Appreciate you taking a look when you have chance.
Thank you
Simonm StageSimon (talk) 16:08, 10 June 2025 (UTC)[reply]
StageSimon, Once you have uploaded all the links I will process them with the bot. I do it in batches it's semi-automated. I will download the links from that page to my local computer into a file, and the bot will run that file as the input. — GreenC 19:23, 10 June 2025 (UTC)[reply]

gigaom.com

[edit]

Defunct tech news outlet replaced by apparent corporate website. James (talk/contribs) 13:26, 29 May 2025 (UTC)[reply]

1,200 pages

Enwiki

  • Checked 1,253 pages and edited 829 pages. Added 12 {{dead link}}. Switched 158 |url-status=live to dead. Added 819 archive URLs (653 Wayback). Changed 8 citation metadata.

IABot DB

  • Checked 2,464 unique URLs and changed 2,453 to propagate through 300+ wikis

 Done -- GreenC 02:28, 8 June 2025 (UTC)[reply]

pbs.org

[edit]

Censorship of website: [32] -- GreenC 17:31, 30 May 2025 (UTC)[reply]

20,688 pages

Enwiki

Pass 1 (00001-03000): Checked 3,000 pages and edited 1,277 pages. Moved 656 links to a new URL: 607 normal redirects, 49 ghost mapped redirects, Resolved 563 soft-404s. Added 24 {{dead link}}. Switched 26 |url-status=dead to live. Switched 90 |url-status=live to dead. Added 529 archive URLs (431 Wayback). Changed 334 citation metadata.
Pass 2 (03001-09000): Checked 6,000 pages and edited 2,549 pages. Moved 1,338 links to a new URL: 1,230 normal redirects, 8 ruled mapped redirects, 100 ghost mapped redirects, Resolved 1,201 soft-404s. Added 51 {{dead link}}. Switched 60 |url-status=dead to live. Switched 188 |url-status=live to dead. Added 1,136 archive URLs (981 Wayback). Changed 451 citation metadata.
Pass 3 (09001-15000): Checked 6,000 pages and edited 2,545 pages. Moved 1,286 links to a new URL: 1,172 normal redirects, 114 ghost mapped redirects, Resolved 1,304 soft-404s. Added 55 {{dead link}}. Switched 64 |url-status=dead to live. Switched 152 |url-status=live to dead. Added 1,226 archive URLs (947 Wayback). Changed 412 citation metadata.
Pass 4 (15001-20143): Checked 5,144 pages and edited 2,201 pages. Moved 1,126 links to a new URL: 1,029 normal redirects, 97 ghost mapped redirects, Resolved 1,023 soft-404s. Added 27 {{dead link}}. Switched 49 |url-status=dead to live. Switched 112 |url-status=live to dead. Added 1,028 archive URLs (848 Wayback). Changed 691 citation metadata.

IABot DB

  • Checked 39,499 unique links and updated 15,205 to propagate through 300+ wikis

 Done -- GreenC 14:49, 12 June 2025 (UTC)[reply]

theathletic.com

[edit]

These links are now part of the New York Times and redirect to their new URLs, such as this going here for Tottenham Hotspur F.C.. However, there are 140 cdn as well. They look to be password protected, like this for Josh Downs. I request the cdn ones to be archived only. ~6300 altogether. Thank you! MrLinkinPark333 (talk) 18:37, 31 May 2025 (UTC)[reply]

Enwiki

IABot DB

  • Checked 7,445 unique links

 Done -- GreenC 19:30, 13 June 2025 (UTC)[reply]

eltiempo.com.ec

[edit]

Although this has a new website at eltiempo.com, it looks like the old links were not kept. An example is this link at Sin Ti... Sin Mi. 103. Thank you again :) MrLinkinPark333 (talk) 18:55, 31 May 2025 (UTC)[reply]

Enwiki

  • Checked 110 pages and edited 62 pages. Added 6 {{dead link}}. Switched 6 |url-status=live to dead. Added 54 archive URLs (52 Wayback).

IABot DB

  • Checked 573 unique links updated 573 to propagate through 300+ wikis

 Done -- GreenC 20:00, 13 June 2025 (UTC)[reply]

aleph0.clarku.edu

[edit]

While editing Triangle inequality, I found an insecure link to http://aleph0.clarku.edu. A Google search found it in more articles than I care to edit. Could someone run a bot or other tool to change the link to https://mathcs.clarku.edu? -- 50.39.108.101 (talk) 00:53, 4 June 2025 (UTC)[reply]

121 pages.
The problem is with a certificate error for https://aleph0.clarku.edu:
$ curl -I https://aleph0.clarku.edu
curl: (60) SSL: no alternative certificate subject name matches target hostname 'aleph0.clarku.edu'
Sysadmins at clarku.edu have been notified.
--50.47.131.244 (talk) 18:59, 8 June 2025 (UTC)[reply]
I could change https:// to http:// and archive any dead links. — GreenC 04:14, 10 June 2025 (UTC)[reply]
With Firefox HTTPS-Only Mode enabled, http:// links are automatically changed to https:// links, if possible. With http://aleph0.clarku.edu, that triggers this warning from Firefox:
HTTPS-Only Mode Alert
Secure Site Not Available
You’ve enabled HTTPS-Only Mode for enhanced security, and a HTTPS version of aleph0.clarku.edu is not available.
My current suggestion is to wait and see if clarku.edu sysadmins fix the certificate problem. When I notified the sysadmins, I included a link to this section.
--50.47.155.77 (talk) 14:23, 10 June 2025 (UTC)[reply]
ω Awaiting direction from 50.47.155.77 — GreenC 20:10, 10 June 2025 (UTC)[reply]

www.konami-data.com

[edit]

While editing List of Nintendo DS Wi-Fi Connection games, I found that the URL was usurped, and redirects to a fake captcha malware now. KamiraMV (talk) 03:28, 4 June 2025 (UTC)[reply]

ω Awaiting next WP:JUDI batch. -- GreenC 19:39, 13 June 2025 (UTC)[reply]

altomfotball.no

[edit]

1865 links to http://www.altomfotball.no now redirects to https://www.tv2.no/livesport/fotball/kamper instead. I cannot find the football statistic data that used to be there somewhere else. Would it be possible to look if the pages are archived? Kaffet i halsen (talk) 11:40, 5 June 2025 (UTC)[reply]

No problem. There is a request backlog right now but it will get done. 716 pages -- GreenC 15:01, 5 June 2025 (UTC)[reply]

Enwiki

  • Checked 716 pages and edited 667 pages. Added 50 {{dead link}}. Switched 20 |url-status=live to dead. Added 1,580 archive URLs (1,404 Wayback).

IABot DB

  • Checked and updated 12,300 unique urls to propagate through 300+ wikis

 Done -- GreenC 06:31, 14 June 2025 (UTC)[reply]

main.sci.gov.in

[edit]

The website main.sci.gov.in certificate has expired and gets no updates. Replace it with api.sci.gov.in please.

135 results

Thanks. AdithyaKL (talk) 16:04, 5 June 2025 (UTC)[reply]

Enwiki

Pass 1: Checked 135 pages and edited 113 pages. Moved 185 links to a new URL: 185 ruled mapped redirects, Switched 10 |url-status=dead to live.
Pass 2: Checked 135 pages and edited 15 pages. Moved 54 links to a new URL: 54 ruled mapped redirects
(missed some due to unknown template {{cite case}})

IABot DB

  • Checked and updated 139 unique URLs which propagate through 300+ wikis

 Done -- GreenC 16:30, 14 June 2025 (UTC)[reply]

perfdrive.com

[edit]

Used by Radware Bot Manager, formerly ShieldSquare. 48 results with a custom search (which specifically excludes accidental archiving of these CAPTCHA pages - those may need to be fixed also). The real URL is stored in the ssc GET parameter. The source titles are often generic (mostly "ShieldSquare Captcha") and ideally would be fixed (though, that may be hard with a bot by design). In the worst case, convert them back into bare URLs and tag them for a human to fix. Thanks! Victoria (OutsideNormality) / talk 01:11, 6 June 2025 (UTC)[reply]

Victoria (OutsideNormality), due to the low number of links, and high complexity of operations, I think this is a job better suited (ie. will take less time and effort and produce cleaner results) to manual or semi-manual such as with WP:AWBREQ. To do this correctly one would: 1. convert the URL to the &ssc version 2. Check if dead. If so add an archive URL 3. Check the archive URL for a title string and update the |title=. 4. Cleanup any other problems, such as |work= and |access-date=.  Not done -- GreenC 16:41, 14 June 2025 (UTC)[reply]
One thing I did is add code so my bot doesn't add new perfdrive.com links, that might show up as redirect destinations. -- GreenC 02:08, 16 June 2025 (UTC)[reply]

Five USA

[edit]

alabama.gov

[edit]
1,050 pages
Enwiki
IABot DB
  • Checked 1,119 unique URLs and updated 630 that will propagate through 300+ wikis
 Done -- GreenC 21:44, 14 June 2025 (UTC)[reply]

alaska.gov

[edit]
1,577 pages
Enwiki
IABot DB
  • Checked 2,424 unique URLs and updated 926 that propagate through 300+ wikis
 Done -- GreenC 05:43, 15 June 2025 (UTC)[reply]

az.gov

[edit]
529 pages
Site has a bad mix of bot blocking, soft-404s, legit dead links, various sub-domains. Sorted best I could under the circumstances.
Enwiki
 Done -- GreenC 20:21, 15 June 2025 (UTC)[reply]

arkansas.gov

[edit]
1,083 pages
Enwiki
IABot DB
  • Checked 1,408 unique URLs and updated 928 to propagate through 300+ wikis
 Done -- GreenC 01:46, 16 June 2025 (UTC)[reply]

ca.gov

[edit]
20,861 pages
 Not done - The State of California government is very complex and my bot appears to be doing as much harm as good ,so I am abandoning it. The culprits are excessive permutations of sub-domains each with its own issues. A lack of consistent rules. Rate limiting followed by bot blocking followed by soft-404s which themselves can not be easily detected. In some cases a PDF returns 200 and displays but has been dynamically replaced by a different PDF (with the same name) that gives a soft-404 message. Unbelievable. Stuff like that throughout that would take weeks to uncover and program for, and yet, with the rate limiting and bot blocks it might not even work. Probably the best approach is break it down into sub-domains and work on each separately. -- GreenC 21:19, 18 June 2025 (UTC)[reply]

politico.com

[edit]

Looks like there's 27 links formatted like "politico.com/states/states". Changing "states/states" to "states" seems to fix the ones I checked GrapesRock (talk) 01:27, 12 June 2025 (UTC)[reply]

Checking this and the rest of the links. -- GreenC 21:28, 23 June 2025 (UTC)[reply]

Enwiki

Pass 1 (00001-03000): Checked 3,000 pages and edited 1,288 pages. Moved 2,084 links to a new URL: 93 normal redirects, 1,964 ruled mapped redirects, 27 ghost mapped redirects, Resolved 56 soft-404s. Added 11 {{dead link}}. Switched 43 |url-status=dead to live. Switched 11 |url-status=live to dead. Added 69 archive URLs (51 Wayback).
Pass 2 (03001-13028): Checked 10,028 pages and edited 4,273 pages. Moved 6,568 links to a new URL: 242 normal redirects, 6,243 ruled mapped redirects, 83 ghost mapped redirects, Resolved 149 soft-404s. Removed 4 {{dead link}}. Added 29 {{dead link}}. Switched 98 |url-status=dead to live. Switched 47 |url-status=live to dead. Added 274 archive URLs (191 Wayback).

IABot DB

  • Checked 27,375 unique URLs and updated 1,382 to propagate through 300+ wikis

 Done -- GreenC 00:05, 25 June 2025 (UTC)[reply]

animal-world.com

[edit]

Animal-world was a repository for facts on animal species and such, but was scooped up by a telehealth vet service, breaking those links.

There aren't that many links with it, only abt 133 EatingCarBatteries (contributions, talk) 03:51, 12 June 2025 (UTC)[reply]

Enwiki

  • Checked 133 pages and edited 129 pages. Switched 6 |url-status=live to dead. Added 150 archive URLs (121 Wayback).

IABot DB

  • Checked and updated 388 unique links

 Done -- GreenC 01:52, 25 June 2025 (UTC)[reply]

hhs.gov

[edit]

United States Department of Health and Human Services -- GreenC 06:37, 14 June 2025 (UTC)[reply]

1,259 pages

Enwiki

IABot DB

  • Checked 2,306 unique links and updated 1,536 to propagate through 300+ wikis

 Done -- GreenC 02:13, 27 June 2025 (UTC)[reply]

usda.gov

[edit]

United States Department of Agriculture -- GreenC 06:37, 14 June 2025 (UTC)[reply]

30,000+ pages

Enwiki

Pass 1 (00001-03000): Checked 3,000 pages and edited 1,071 pages. Moved 1,104 links to a new URL: 292 normal redirects, 788 ruled mapped redirects, 24 ghost mapped redirects, Resolved 106 soft-404s. Removed 1 {{dead link}}. Added 38 {{dead link}}. Switched 41 |url-status=dead to live. Switched 30 |url-status=live to dead. Added 242 archive URLs (227 Wayback).
Pass 2 (03001-09000): Checked 6,000 pages and edited 2,695 pages. Moved 2,851 links to a new URL: 689 normal redirects, 2,071 ruled mapped redirects, 91 ghost mapped redirects, Resolved 387 soft-404s. Removed 4 {{dead link}}. Added 129 {{dead link}}. Switched 163 |url-status=dead to live. Switched 64 |url-status=live to dead. Added 631 archive URLs (578 Wayback).
Pass 3 (09001-20000):  In progress -- GreenC 05:44, 28 June 2025 (UTC)[reply]

dol.gov

[edit]

United States Department of Labor

936 pages

adventuregamer.com

[edit]

Adventure Gamers has been usurped by its new owners to focus on gambling promotion per discussion at the video games project. Impact seems small with 33 pages. Sariel Xilo (talk) 15:18, 15 June 2025 (UTC)[reply]

It's adventuregamerS.com, with a plural S at the end.--LaukkuTheGreit (Talk•Contribs) 15:26, 15 June 2025 (UTC)[reply]
My bad! adventuregamers.com has more pages over 800. Sariel Xilo (talk) 15:32, 15 June 2025 (UTC)[reply]

RadioGOLDINdex

[edit]

RadioGOLDINdex has 241 Results

Copyright, J. David Goldin

https://web.archive.org/web/*/http://www.radiogoldindex.com/

https://web.archive.org/web/*/http://www.radiogoldindex.com/*

now:

http://radiogoldin.library.umkc.edu/

Piñanana (talk) 02:09, 22 June 2025 (UTC)[reply]

climate.gov

[edit]

Site permanently removed by Trump administration order effective June 23. 282 pages -- GreenC 14:43, 24 June 2025 (UTC)[reply]

aje.io and Al Jazeera

[edit]

@GreenC, Al Jazeera now uses aje.io domain as their URL redirection site for their articles. As they are shortlinks, we would not be able to track or trace back to the original webpage if they choose to sunset the service. As the use is widespread, and to preemptively prevent link rot, can you help with the expansion of the URLs? I will have this domain added to Special:BlockedExternalDomains as well (when would be a better time, now or after the URLs have been expanded?) – robertsky (talk) 15:44, 24 June 2025 (UTC)[reply]

206 pages.
– robertsky, this is a good idea. The bot will automatically expand the URLs as they are normal 301 redirects. It probably won't matter when they are blocked because the bot is not saving the short form. If you want to wait out of caution that's fine or if you want to block now and something breaks, I can let you know and we can unblock temporarily (if not disruptive to some other process). This job is in the queue it might be a week or so before I finish the requests preceding. But if you want it faster can do, 200 pages won't take long. -- GreenC 16:06, 24 June 2025 (UTC)[reply]
@GreenC I have added the block list. This would cut down the amount of work or runs the bot has to do after the initial run. – robertsky (talk) 14:18, 25 June 2025 (UTC)[reply]