earthlink.net
robots.txt

Robots Exclusion Standard data for earthlink.net

Resource Scan

Scan Details

Site Domain earthlink.net
Base Domain earthlink.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-02-29T18:22:24+00:00
Next Scan 2024-05-29T18:22:24+00:00

Last Successful Scan

Scanned2023-11-02T16:31:20+00:00
URL https://earthlink.net/robots.txt
Redirect https://www.earthlink.net/robots.txt
Redirect Domain www.earthlink.net
Redirect Base earthlink.net
Domain IPs 104.18.208.148, 104.19.239.228, 2606:4700::6812:d094, 2606:4700::6813:efe4
Redirect IPs 104.18.208.148, 104.19.239.228, 2606:4700::6812:d094, 2606:4700::6813:efe4
Response IP 104.19.239.228
Found Yes
Hash aa5c5c5aec46f5ddddde15542813319479a1bd513d403bdc374dec9e60716c04
SimHash 68753844999a

Groups

proximic

Rule Path
Disallow

*

Rule Path
Disallow /wp-admin/
Disallow /portfolio/
Disallow /tag/
Disallow /wp-admin/admin-ajax.php
Disallow /author/*
Disallow /category/*
Disallow /l/email-protection*
Disallow /*?symb=*
Disallow /*?page=markets&amp%3B*
Disallow /*?guid=*
Disallow /*?_g_gac=*
Disallow /*?cpid=*
Disallow /*?fbclid=*
Disallow /?campaignid-cons*
Disallow /*track?id=*
Disallow /undefined/
Disallow /search/
Disallow /wp-content/

Other Records

Field Value
sitemap https://www.earthlink.net/sitemap_index.xml