aruppukkottai.adeex.in
robots.txt

Robots Exclusion Standard data for aruppukkottai.adeex.in

Resource Scan

Scan Details

Site Domain aruppukkottai.adeex.in
Base Domain adeex.in
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-05T11:15:25+00:00
Next Scan 2025-09-03T11:15:25+00:00

Last Successful Scan

Scanned2025-04-30T09:49:10+00:00
URL https://aruppukkottai.adeex.in/robots.txt
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.96.1
Found Yes
Hash 77ae0a1647bef26a10b12b4d3e7fc6909195b47ce0db4072e2db2d41aaee12ca
SimHash 501de8e1c680

Groups

googlebot

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Disallow /comments/qualify/*

adsbot-google

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Disallow /comments/qualify/*

googlebot-image

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Disallow /comments/qualify/*

*

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Allow /ajax/static_blocks

petalbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yadirectbot

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

w3c-checklink

Rule Path
Disallow /

badbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

applebot

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

seekportbot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

voilabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

amazonbot
anthropic-ai
applebot-extended
awariorssbot
awariosmartbot
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
dataforseobot
facebookbot
google-extended
gptbot
imagesiftbot
magpie-crawler
omgili
omgilibot
peer39_crawler
peer39_crawler/1.0
perplexitybot
youbot

Rule Path
Disallow /

Comments

  • User-agent: MJ12bot
  • disallow: /
  • User-agent: ia_archiver
  • Disallow: /