telemundonebraska.com
robots.txt

Robots Exclusion Standard data for telemundonebraska.com

Resource Scan

Scan Details

Site Domain telemundonebraska.com
Base Domain telemundonebraska.com
Scan Status Ok
Last Scan2024-11-11T05:32:40+00:00
Next Scan 2024-11-18T05:32:40+00:00

Last Scan

Scanned2024-11-11T05:32:40+00:00
URL https://telemundonebraska.com/robots.txt
Redirect https://www.telemundonebraska.com/robots.txt
Redirect Domain www.telemundonebraska.com
Redirect Base telemundonebraska.com
Domain IPs 100.25.172.61, 54.145.205.131
Redirect IPs 104.18.0.170, 104.18.1.170, 2606:4700::6812:1aa, 2606:4700::6812:aa
Response IP 104.18.0.170
Found Yes
Hash 740f9bd07d21dc4dfa45e06f48236148666ab5d5de424ed04ebd0dcb53dfd564
SimHash 45bd7f4c3ad3

Groups

*

Rule Path
Disallow /ads/
Disallow /global/tools/
Disallow /global/interfaces/
Disallow /global/images/
Disallow /global/include/
Disallow /global/applications/
Disallow /global/pm/
Disallow /global/utilities/
Disallow /global/reports/
Disallow /global/video/
Disallow /applications/
Disallow /cgi-bin/
Disallow /classifieds/
Disallow /default_files/
Disallow /images/
Disallow /include/
Disallow /incoming/
Disallow /reports/
Disallow /professionalservices/
Disallow /search
Disallow /temp/
Disallow /trafficcam/
Disallow /traffic/
Disallow /contentmgmt/
Disallow /register
Disallow /login
Disallow /forgot-password
Disallow /reset-password
Disallow /profile

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.telemundonebraska.com/sitemap.xml.gz
sitemap https://www.telemundonebraska.com/sitemap-pages.xml.gz
sitemap https://www.telemundonebraska.com/newssitemap.xml.gz
sitemap https://www.telemundonebraska.com/videositemap.xml.gz