agnesb.us
robots.txt

Robots Exclusion Standard data for agnesb.us

Resource Scan

Scan Details

Site Domain agnesb.us
Base Domain agnesb.us
Scan Status Ok
Last Scan2024-05-13T17:09:38+00:00
Next Scan 2024-06-12T17:09:38+00:00

Last Scan

Scanned2024-05-13T17:09:38+00:00
URL https://agnesb.us/robots.txt
Redirect https://www.agnesb.us/robots.txt
Redirect Domain www.agnesb.us
Redirect Base agnesb.us
Domain IPs 104.26.10.6, 104.26.11.6, 172.67.70.194, 2606:4700:20::681a:a06, 2606:4700:20::681a:b06, 2606:4700:20::ac43:46c2
Redirect IPs 104.26.10.6, 104.26.11.6, 172.67.70.194, 2606:4700:20::681a:a06, 2606:4700:20::681a:b06, 2606:4700:20::ac43:46c2
Response IP 172.67.70.194
Found Yes
Hash 7107fa058dc30a5afc647c1f54cc2e7757b2bbb072314229536c7d07d8afc3ba
SimHash 594a5d941dc2

Groups

*

Rule Path
Disallow /admin.php/
Disallow /rest.php/
Disallow /rest.V1.php/
Disallow /ua.php/
Disallow /uaRest.php/
Disallow /ajax.php/
Disallow /ajax.V1.php/
Disallow /widget.php/
Disallow /widgetAPI.php/
Disallow /_service.php/
Disallow /storage.php/
Disallow /index.php/
Disallow /preview.php/
Disallow /ajaxPreview.php/
Disallow /index.php/

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /en/r-sultats-de-recherche-produits.html
Disallow /resultats-de-recherche-produits.html
Disallow /product-search-results.html

Other Records

Field Value
sitemap https://www.agnesb.us/Assets/Rbs/Seo/sitemap-index.xml