cuttack.adeex.in
robots.txt

Robots Exclusion Standard data for cuttack.adeex.in

Resource Scan

Scan Details

Site Domain cuttack.adeex.in
Base Domain adeex.in
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-07-02T09:26:28+00:00
Next Scan 2025-08-31T09:26:28+00:00

Last Successful Scan

Scanned2024-11-17T22:54:56+00:00
URL https://cuttack.adeex.in/robots.txt
Domain IPs 104.21.12.120, 172.67.132.36, 2606:4700:3036::ac43:8424, 2606:4700:3037::6815:c78
Response IP 172.67.132.36
Found Yes
Hash 77ae0a1647bef26a10b12b4d3e7fc6909195b47ce0db4072e2db2d41aaee12ca
SimHash 501de8e1c680

Groups

googlebot

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Disallow /comments/qualify/*

adsbot-google

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Disallow /comments/qualify/*

googlebot-image

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Disallow /comments/qualify/*

*

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Allow /ajax/static_blocks

petalbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yadirectbot

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

w3c-checklink

Rule Path
Disallow /

badbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

applebot

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

seekportbot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

voilabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

amazonbot
anthropic-ai
applebot-extended
awariorssbot
awariosmartbot
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
dataforseobot
facebookbot
google-extended
gptbot
imagesiftbot
magpie-crawler
omgili
omgilibot
peer39_crawler
peer39_crawler/1.0
perplexitybot
youbot

Rule Path
Disallow /

Comments

  • User-agent: MJ12bot
  • disallow: /
  • User-agent: ia_archiver
  • Disallow: /