buscobus.pe
robots.txt

Robots Exclusion Standard data for buscobus.pe

Resource Scan

Scan Details

Site Domain buscobus.pe
Base Domain buscobus.pe
Scan Status Ok
Last Scan2024-11-11T21:45:35+00:00
Next Scan 2024-11-18T21:45:35+00:00

Last Scan

Scanned2024-11-11T21:45:35+00:00
URL https://buscobus.pe/robots.txt
Domain IPs 104.21.49.107, 172.67.189.192, 2606:4700:3031::ac43:bdc0, 2606:4700:3036::6815:316b
Response IP 104.21.49.107
Found Yes
Hash 6feff568ee2c5cf2925915d9dc4a9437e13a7e5fc82fa6ffdc1d0392b281872b
SimHash 41419a524612

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins/
Disallow /wp-content/doc_templates/
Disallow *?replytocom

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

Other Records

Field Value
sitemap https://buscobus.pe/sitemap_index.xml