Log In Sign Up

exadel.com
robots.txt

Robots Exclusion Standard data for exadel.com

Resource Scan

Scan Details

Site Domain exadel.com
Base Domain exadel.com
Scan Status Ok
Last Scan2025-05-13T13:20:57+00:00
Next Scan 2025-06-12T13:20:57+00:00

Last Scan

Scanned2025-05-13T13:20:57+00:00
URL https://exadel.com/robots.txt
Domain IPs 104.22.10.82, 104.22.11.82, 172.67.20.98
Response IP 104.22.10.82
Found Yes
Hash af3c5d52c6b7017da4ea1f2c6d985c861fe7bf16d06b0f9278ae2204ec97bdd0
SimHash d87c5dc884ea

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /cdn-cgi/
Disallow /search/
Disallow /wp-login.php
Disallow /wp-signup.php
Disallow /feed/
Disallow */feed/
Disallow */rss2/
Disallow *?feed=*

bot-traffic
bottraffic
trafficbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seokicks-robot
seokicks

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-content/cache/
Back to top

Other Records

Field Value
sitemap https://exadel.com/sitemap_index.xml
Back to top

Comments

  • RSS Feeds
  • Various Bots
  • https://www.brandwatch.com/legal/magpie-crawler/
  • http://webmeup-crawler.com/#what
  • https://commoncrawl.org/big-picture/frequently-asked-questions/
  • https://www.seokicks.de/robot.html
  • https://awario.com/bots.html
  • http://omgili.com/crawler.html
  • BEGIN W3TC ROBOTS
  • END W3TC ROBOTS
Back to top