mashbot.com
robots.txt

Robots Exclusion Standard data for mashbot.com

Resource Scan

Scan Details

Site Domain mashbot.com
Base Domain mashbot.com
Scan Status Ok
Last Scan2024-11-19T06:44:24+00:00
Next Scan 2024-12-03T06:44:24+00:00

Last Scan

Scanned2024-11-19T06:44:24+00:00
URL https://mashbot.com/robots.txt
Redirect https://www.mashbot.com/robots.txt
Redirect Domain www.mashbot.com
Redirect Base mashbot.com
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 52.197.0.54, 52.199.221.217, 54.178.223.218
Response IP 54.178.223.218
Found Yes
Hash ca0ac4bc81ea3ef81c655ea9caa82e79d1abe4657b1cb18dd0b8b9eb3878caec
SimHash 491cc0524511

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.mashbot.com/sitemap.xml