agronomia.anunciosgratis.com.ar
robots.txt

Robots Exclusion Standard data for agronomia.anunciosgratis.com.ar

Resource Scan

Scan Details

Site Domain agronomia.anunciosgratis.com.ar
Base Domain anunciosgratis.com.ar
Scan Status Ok
Last Scan2024-10-03T03:47:36+00:00
Next Scan 2024-11-02T03:47:36+00:00

Last Scan

Scanned2024-10-03T03:47:36+00:00
URL https://agronomia.anunciosgratis.com.ar/robots.txt
Domain IPs 104.21.68.138, 172.67.195.237, 2606:4700:3030::6815:448a, 2606:4700:3037::ac43:c3ed
Response IP 104.21.68.138
Found Yes
Hash bb079195955dba6af85ab630c2344532a27f12c342417e1f6019b07f3df3629e
SimHash e73c2027e3a9

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

facebookexternalhit/*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5