autos-motos.net
robots.txt

Robots Exclusion Standard data for autos-motos.net

Resource Scan

Scan Details

Site Domain autos-motos.net
Base Domain autos-motos.net
Scan Status Ok
Last Scan2024-11-13T14:14:29+00:00
Next Scan 2024-11-20T14:14:29+00:00

Last Scan

Scanned2024-11-13T14:14:29+00:00
URL https://autos-motos.net/robots.txt
Domain IPs 62.84.245.92
Response IP 62.84.245.92
Found Yes
Hash 32111b00222aae002125765585187a8e95765094ecd4bf93ddb9953c69baf3f9
SimHash 481c0940af53

Groups

*
amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

proximic

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

googlebot

Rule Path
Allow /ads.txt

Other Records

Field Value
sitemap http://www.autos-motos.net/sitemap.xml