rotorooter.com
robots.txt

Robots Exclusion Standard data for rotorooter.com

Resource Scan

Scan Details

Site Domain rotorooter.com
Base Domain rotorooter.com
Scan Status Ok
Last Scan2024-09-26T12:50:14+00:00
Next Scan 2024-10-26T12:50:14+00:00

Last Scan

Scanned2024-09-26T12:50:14+00:00
URL https://rotorooter.com/robots.txt
Redirect https://www.rotorooter.com/robots.txt
Redirect Domain www.rotorooter.com
Redirect Base rotorooter.com
Domain IPs 40.122.78.61
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 655ba23d21516b562a185d847e5ab6de62de2b4c1c3a568eadc2e87791f44014
SimHash 221e5a31cef0

Groups

*

Rule Path
Disallow /servlets/
Disallow /Captcha.jpg
Disallow /servlets/htmlpdf
Disallow /servlets/pdf
Disallow /*?cmpid=
Disallow /*?CMPID=
Disallow /phone_call.html
Disallow /dave/
Disallow */rss.html
Disallow /easttawasmi/
Disallow /easttawasmi/?cmpid=98789
Disallow /paidsocial/
Disallow /newsletters/
Disallow /newsletters/*
Disallow /residential-free-estimates/
Disallow /careers/benefits/
Disallow /app/*

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.rotorooter.com/sitemaps/sitemap-index.xml