exeideas.com
robots.txt

Robots Exclusion Standard data for exeideas.com

Resource Scan

Scan Details

Site Domain exeideas.com
Base Domain exeideas.com
Scan Status Ok
Last Scan2026-01-04T17:24:19+00:00
Next Scan 2026-01-11T17:24:19+00:00

Last Scan

Scanned2026-01-04T17:24:19+00:00
URL https://exeideas.com/robots.txt
Domain IPs 145.223.106.102, 2a02:4780:b:1097:0:3421:83b8:5
Response IP 145.223.106.102
Found Yes
Hash 1c635ade61b6bfaee1afb6b0d4f6c1ef547b26ffaf4550b50382cc681c614100
SimHash 60598a0147e2

Groups

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

semrushbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Allow /

*

Rule Path
Disallow /cgi-bin/

Other Records

Field Value
sitemap http://www.exeideas.com/custom-cat-sitemap.xml
sitemap http://www.exeideas.com/custom-sitemap-1.xml
sitemap http://www.exeideas.com/custom-sitemap-2.xml
sitemap http://www.exeideas.com/custom-sitemap-3.xml
sitemap http://www.exeideas.com/custom-sitemap-4.xml
sitemap http://www.exeideas.com/custom-sitemap-5.xml

Comments

  • Allow major search engines
  • General rule for all other bots
  • Sitemap URLs