thisistorrevieja.com
robots.txt

Robots Exclusion Standard data for thisistorrevieja.com

Resource Scan

Scan Details

Site Domain thisistorrevieja.com
Base Domain thisistorrevieja.com
Scan Status Ok
Last Scan2024-11-10T22:56:33+00:00
Next Scan 2024-11-17T22:56:33+00:00

Last Scan

Scanned2024-11-10T22:56:33+00:00
URL https://thisistorrevieja.com/robots.txt
Domain IPs 149.255.62.172
Response IP 149.255.62.172
Found Yes
Hash 05f62762272c386ac226d7b92711501afa9457e2bbcf59cb510425238bc3e93c
SimHash 4930d872c9b3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 20

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://thisistorrevieja.com/sitemap.xml
sitemap https://thisistorrevieja.com/sitemap.rss