gusto.it
robots.txt

Robots Exclusion Standard data for gusto.it

Resource Scan

Scan Details

Site Domain gusto.it
Base Domain gusto.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-05-02T03:59:55+00:00
Next Scan 2024-07-01T03:59:55+00:00

Last Successful Scan

Scanned2024-02-10T03:11:00+00:00
URL https://gusto.it/robots.txt
Domain IPs 88.99.4.156
Response IP 88.99.4.156
Found Yes
Hash d2e787d815d9df36652d116c5e5b24437e89ecb0e39797a6881f7ec4a528e3cd
SimHash 480c9c026a92

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://gusto.it/sitemaps.xml