digidikdigi.com
robots.txt

Robots Exclusion Standard data for digidikdigi.com

Resource Scan

Scan Details

Site Domain digidikdigi.com
Base Domain digidikdigi.com
Scan Status Ok
Last Scan5/20/2025, 3:37:12 AM
Next Scan 6/19/2025, 3:37:12 AM

Last Scan

Scanned5/20/2025, 3:37:12 AM
URL https://digidikdigi.com/robots.txt
Redirect https://www.digidikdigi.com/robots.txt
Redirect Domain www.digidikdigi.com
Redirect Base digidikdigi.com
Domain IPs 212.146.128.155
Redirect IPs 212.146.128.155
Response IP 212.146.128.155
Found Yes
Hash 183d3f7bb20b4d80c9996b0d72949392617a313b7f563aea48aad2fdb28dcefd
SimHash 782b0880c041

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

ai2bot
ai2bot-dolma
amazonbot
applebot-extended
anthropic-ai
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
cohere-training-data-crawler
crawlspace
diffbot
facebookbot
friendlycrawler
gptbot
google-extended
imagesiftbot
kangaroo bot
meta-externalagent
meta-externalfetcher
oai-searchbot
omgili
omgilibot
pangubot
petalbot
perplexitybot
scrapy
semrushbot
semrushbot-ocob
semrushbot-ft
sentibot
sentibot
timpibot
turnitinbot
youbot
webzio
webzio-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.digidikdigi.com/wp-sitemap.xml

Comments

  • Block AI Crawlers - Built-In Rules
  • End Block AI Crawlers - Built-In Rules