bbwtodate.com
robots.txt
Robots Exclusion Standard data for bbwtodate.com
Resource Scan
Scan Details
Site Domain | bbwtodate.com |
Base Domain | bbwtodate.com |
Scan Status | Ok |
Last Scan | 2024-06-14T21:33:20+00:00 |
Next Scan | 2024-07-14T21:33:20+00:00 |
Last Scan
Scanned | 2024-06-14T21:33:20+00:00 |
URL | https://bbwtodate.com/robots.txt |
Redirect | https://www.bbwtodate.com/robots.txt |
Redirect Domain | www.bbwtodate.com |
Redirect Base | bbwtodate.com |
Domain IPs | 142.93.74.86, 64.225.33.137 |
Redirect IPs | 23.52.171.66, 23.59.168.170, 2600:1413:b000:1b::17d7:710, 2600:1413:b000:1b::17d7:714 |
Response IP | 23.59.168.170 |
Found | Yes |
Hash | 4f3892fb3343e70b5f220039a8a18ec20877fde0af00cdb117f4a1840f14820b |
SimHash | 28154840cb33 |
Groups
*
Rule | Path |
---|---|
Disallow | *autologin* |
*
Rule | Path |
---|---|
Disallow | /landing/mta |
Disallow | /t/tr |
Other Records
Field | Value |
---|---|
sitemap | https://www.bbwtodate.com/sitemap.xml |