modernbathroom.com
robots.txt
Robots Exclusion Standard data for modernbathroom.com
Resource Scan
Scan Details
Site Domain | modernbathroom.com |
Base Domain | modernbathroom.com |
Scan Status | Ok |
Last Scan | 2024-11-05T12:31:07+00:00 |
Next Scan | 2024-12-05T12:31:07+00:00 |
Last Scan
Scanned | 2024-11-05T12:31:07+00:00 |
URL | https://modernbathroom.com/robots.txt |
Redirect | https://www.modernbathroom.com/robots.txt |
Redirect Domain | www.modernbathroom.com |
Redirect Base | modernbathroom.com |
Domain IPs | 104.20.25.186, 104.20.26.186, 172.67.1.222, 2606:4700:10::6814:19ba, 2606:4700:10::6814:1aba, 2606:4700:10::ac43:1de |
Redirect IPs | 104.20.25.186, 104.20.26.186, 172.67.1.222, 2606:4700:10::6814:19ba, 2606:4700:10::6814:1aba, 2606:4700:10::ac43:1de |
Response IP | 104.20.26.186 |
Found | Yes |
Hash | cfd786e4381b0b15e5378762f8fd94c6eaff808df51ca22c8090a73f34e18e65 |
SimHash | 0965ddb4c293 |
Groups
baiduspider
baiduspider-image
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-cpro
baiduspider-ads
Rule | Path |
---|---|
Disallow | / |
yandexbot
yandexdirect
yandexdirectdyn
yandexmedia
yandeximages
yadirectfetcher
yandexblogs
yandexnews
yandexpagechecker
yandexmetrika
yandexcalendar
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Allow | / |
Disallow | /files/ |
Disallow | /bathroom-brands/jacuzzi.aspx |
Other Records
Field | Value |
---|---|
sitemap | http://www.modernbathroom.com/sitemap.xml |