Log In Sign Up

efree.in
robots.txt

Robots Exclusion Standard data for efree.in

Resource Scan

Scan Details

Site Domain efree.in
Base Domain efree.in
Scan Status Ok
Last Scan2024-11-13T07:16:35+00:00
Next Scan 2024-11-20T07:16:35+00:00

Last Scan

Scanned2024-11-13T07:16:35+00:00
URL https://efree.in/robots.txt
Domain IPs 185.151.30.172, 2a07:7800::172
Response IP 185.151.30.172
Found Yes
Hash 5e74f208b9faf94a373c842d27d6e7944b748a2e69524cf6039f9ed3afe4d92b
SimHash 6ed5573457b8

Groups

*

Rule Path
Disallow

adsbot-google
bingpreview
deepcrawl
googlebot
googlebot-image
googlebot-mobile
mediapartners-google
stc-bot
searchmetricsbot
twitterbot
yahoo! slurp
archive.org_bot
bingbot
ia_archiver
zoominfobot
wikido
riddler
petalbot
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.efree.in/sitemap_index.xml
sitemap https://www.efree.in/sitemap_index.xml
sitemap https://www.efree.in/category-sitemap.xml
sitemap https://www.efree.in/listing-sitemap.xml
sitemap https://www.efree.in/events-sitemap.xml
sitemap https://www.efree.in/page-sitemap.xml
sitemap https://www.efree.in/post-sitemap.xml
Back to top

Comments

  • Allow all URLs (see http://www.robotstxt.org/robotstxt.html)
  • Sitemap
  • -----------------
Back to top

Warnings

  • 3 invalid lines.
Back to top