encycolorpedia.pt
robots.txt

Robots Exclusion Standard data for encycolorpedia.pt

Resource Scan

Scan Details

Site Domain encycolorpedia.pt
Base Domain encycolorpedia.pt
Scan Status Ok
Last Scan2024-10-05T15:32:12+00:00
Next Scan 2024-10-12T15:32:12+00:00

Last Scan

Scanned2024-10-05T15:32:12+00:00
URL https://encycolorpedia.pt/robots.txt
Domain IPs 104.21.23.79, 172.67.209.205, 2606:4700:3032::ac43:d1cd, 2606:4700:3035::6815:174f
Response IP 172.67.209.205
Found Yes
Hash 3d4db17ca41eddfc5dc73a13ebf7e5dc3e7cd83c8a71d15e5e5f7478260996aa
SimHash 531cf942ee91

Groups

*

Rule Path
Disallow /go/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

dotbot
ahrefsbot
ia_archiver
archive.org_bot
exabot
linguee
proximic
semrushbot
semrushbot-sa
netseer
seekportbot
criteobot/0.1
gptbot
sirdatabot
petalbot
adbeat_bot
grapeshot
serpstatbot
awariorssbot
awariosmartbot
amazonbot
yacybot
repolookoutbot
claudebot
imagesiftbot
gptbot
chatgpt-user
google-extended
ccbot
perplexitybot
anthropic-ai
claude-web

Rule Path
Disallow /

Other Records

Field Value
sitemap https://encycolorpedia.pt/sitemaps.xml