Log In Sign Up

elireview.com
robots.txt

Robots Exclusion Standard data for elireview.com

Resource Scan

Scan Details

Site Domain elireview.com
Base Domain elireview.com
Scan Status Ok
Last Scan2025-11-11T01:45:39+00:00
Next Scan 2025-12-11T01:45:39+00:00

Last Scan

Scanned2025-11-11T01:45:39+00:00
URL https://elireview.com/robots.txt
Domain IPs 104.26.0.208, 104.26.1.208, 172.67.71.32, 2606:4700:20::681a:1d0, 2606:4700:20::681a:d0, 2606:4700:20::ac43:4720
Response IP 172.67.71.32
Found Yes
Hash 241a496af63be250fbc9219cd22ed407f539770f4ca4bd4463e13fd32dd70832
SimHash 31a55953cf14

Groups

*

Rule Path
Disallow /events/category/live-event/list/

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-register.php

*

Rule Path
Disallow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /events/*

googlebot

Rule Path
Allow /wp-includes/js/
Allow /wp-content/themes/
Allow /wp-content/plugins/

googlebot

Rule Path
Disallow /cgi-bin/
Disallow /tmp/
Disallow /junk/
Disallow /archive/
Disallow /test/
Disallow /old/
Disallow /backup/
Disallow *.pdf
Disallow *.docx
Disallow *.xls

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /private/
Back to top

Other Records

Field Value
sitemap https://elireview.com/sitemap.xml
Back to top

Comments

  • All robots will spider the domain
  • Disallow folder /wp-admin/
  • This is a standard practice to prevent bots from accessing the WordPress admin area
  • Disallow access to the AJAX handler script in WordPress
  • Disallow event crawling
  • Allow Googlebot to access the JavaScript and CSS files
  • Prevent Googlebot from indexing certain directories and file types
  • Prevent Amazonbot from crawling the entire site (Example directive)
  • Prevent any bot from accessing a specific directory
  • Prevent any bot from accessing a specific file
  • User-agent: *
  • Disallow: /private/file-to-hide.html
  • Sitemap parameter specifies the path to your sitemap file
Back to top