nl.appcracy.com
robots.txt

Robots Exclusion Standard data for nl.appcracy.com

Resource Scan

Scan Details

Site Domain nl.appcracy.com
Base Domain appcracy.com
Scan Status Ok
Last Scan2025-05-20T00:39:15+00:00
Next Scan 2025-06-19T00:39:15+00:00

Last Scan

Scanned2025-05-20T00:39:15+00:00
URL https://nl.appcracy.com/robots.txt
Domain IPs 172.66.41.21, 172.66.42.235, 2606:4700:3108::ac42:2915, 2606:4700:3108::ac42:2aeb
Response IP 172.66.42.235
Found Yes
Hash a16c47f49c4f1b23428f82f7484a486e35ff676ff3f4b96df64c147e8d95cf90
SimHash 090cc81aaf11

Groups

ias_crawler
ias_wombles

Rule Path
Allow /

*

Rule Path
Disallow /?download=*
Disallow /?s=*

baiduspider*
sogou*

Rule Path
Disallow /

ahrefsbot
blexbot
ccbot
cliqzbot
dotbot
ia_archiver
mbcrawler
mj12bot
photon
scrapy
semrushbot
linguee

Rule Path
Disallow /

Other Records

Field Value
sitemap https://br.appcracy.com/sitemaps/sitemap.xml