digidikdigi.com
robots.txt
Robots Exclusion Standard data for digidikdigi.com
Resource Scan
Scan Details
Site Domain | digidikdigi.com |
Base Domain | digidikdigi.com |
Scan Status | Ok |
Last Scan | 5/20/2025, 3:37:12 AM |
Next Scan | 6/19/2025, 3:37:12 AM |
Last Scan
Scanned | 5/20/2025, 3:37:12 AM |
URL | https://digidikdigi.com/robots.txt |
Redirect | https://www.digidikdigi.com/robots.txt |
Redirect Domain | www.digidikdigi.com |
Redirect Base | digidikdigi.com |
Domain IPs | 212.146.128.155 |
Redirect IPs | 212.146.128.155 |
Response IP | 212.146.128.155 |
Found | Yes |
Hash | 183d3f7bb20b4d80c9996b0d72949392617a313b7f563aea48aad2fdb28dcefd |
SimHash | 782b0880c041 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
ai2bot
ai2bot-dolma
amazonbot
applebot-extended
anthropic-ai
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
cohere-training-data-crawler
crawlspace
diffbot
facebookbot
friendlycrawler
gptbot
google-extended
imagesiftbot
kangaroo bot
meta-externalagent
meta-externalfetcher
oai-searchbot
omgili
omgilibot
pangubot
petalbot
perplexitybot
scrapy
semrushbot
semrushbot-ocob
semrushbot-ft
sentibot
sentibot
timpibot
turnitinbot
youbot
webzio
webzio-extended
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.digidikdigi.com/wp-sitemap.xml |
Comments