Log In Sign Up

alexdata.com
robots.txt

Robots Exclusion Standard data for alexdata.com

Resource Scan

Scan Details

Site Domain alexdata.com
Base Domain alexdata.com
Scan Status Ok
Last Scan2025-07-29T01:10:06+00:00
Next Scan 2025-08-05T01:10:06+00:00

Last Scan

Scanned2025-07-29T01:10:06+00:00
URL https://alexdata.com/robots.txt
Redirect https://alexdata.com/zite_resources/robots.txt
Domain IPs 2a02:2350:5:10c:806d:50cc:a55a:6227, 46.30.213.173
Response IP 46.30.213.173
Found Yes
Hash fd35fd1b265b7e342d3fc917209babafabb7e106bb6dd2201c6dcfd54c2b5c63
SimHash 595c0647d597

Groups

*

Rule Path
Disallow /bot-stop-blackhole/
Disallow /bot-ai-script-trap-blackhole/
Disallow /blackhole/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /FORUMPOSTS/
Disallow /MYPROGRAMS/
Disallow /PUBLIC/
Disallow /HEALTH/
Disallow /RESOURCES/HEALTH/
Disallow /NEW/SONGS/COLLECTION4/
Disallow /NEW/SONGS/COLLECTION3/
Disallow /NEW/SONGS/COLLECTION2/
Disallow /NEW/SONGS/COLLECTION1/
Disallow /ANDROID/
Disallow /RESOURCES/
Disallow /NEW/CONTACT/
Disallow /RESOURCES/ADS/
Back to top

Other Records

Field Value
sitemap https://alexdata.com/ZITE-3RD-PARTY/sitemap-alexdata-com.xml
Back to top

Comments

  • GOOGLE-BOT--STILL-TRYING-TO-LOA-THESE-OUTDATED-SITES--SO-I-REMOVED-THEM-FOR-GOOGLEBOT
  • https://developers.google.com/search/docs/crawling-indexing/block-indexing?visit_id=638284396168478599-4006610343&rd=1
  • https://support.google.com/webmasters/answer/7440203#discovered__unclear_status
  • DIFFERENT-PAGES-THAT-SHOULD-NOT-BE-TRAVERSED-OR-INDEXED-BY-ROBOTS-ABOVE
  • SITE-MAP-FOR-SEARCH-ENGINES--EXTRA-TEXT-UNDER-THE-SITE-LINK-IN-SRC-RESULT
  • https://www.google.com/ping?sitemap=https://alexdata.com/ZITE-3RD-PARTY/sitemap-alexdata-com.xml
  • HOW-TO-SITEMAP https://developers.google.com/search/docs/crawling-indexing/sitemaps/build-sitemap?visit_id=638220381336010120-2321360728&rd=1#xm
  • https://search.google.com/search-console/sitemaps?resource_id=http%3A%2F%2Fwww.alexdata.com%2F&hl=en
Back to top