mobilemodular.com
robots.txt

Robots Exclusion Standard data for mobilemodular.com

Resource Scan

Scan Details

Site Domain mobilemodular.com
Base Domain mobilemodular.com
Scan Status Ok
Last Scan2025-09-26T16:29:16+00:00
Next Scan 2025-10-26T16:29:16+00:00

Last Scan

Scanned2025-09-26T16:29:16+00:00
URL https://mobilemodular.com/robots.txt
Redirect https://www.mobilemodular.com/robots.txt
Redirect Domain www.mobilemodular.com
Redirect Base mobilemodular.com
Domain IPs 191.236.80.12
Redirect IPs 40.118.235.113
Response IP 40.118.235.113
Found Yes
Hash 75bff843b75a8c87488bd2b363a44b590d38930146f6cfb87bc146150dead45a
SimHash 36979149a3f1

Groups

*

Rule Path
Allow /blog/core/*.css$
Allow /blog/core/*.css?
Allow /blog/core/*.js$
Allow /blog/core/*.js?
Allow /blog/core/*.gif
Allow /blog/core/*.jpg
Allow /blog/core/*.jpeg
Allow /blog/core/*.png
Allow /blog/core/*.svg
Allow /blog/profiles/*.css$
Allow /blog/profiles/*.css?
Allow /blog/profiles/*.js$
Allow /blog/profiles/*.js?
Allow /blog/profiles/*.gif
Allow /blog/profiles/*.jpg
Allow /blog/profiles/*.jpeg
Allow /blog/profiles/*.png
Allow /blog/profiles/*.svg
Allow /blog/?page=*
Allow /blog/category/*
Disallow /blog/core/
Disallow /blog/profiles/
Disallow /blog/README.txt
Disallow /blog/web.config
Disallow /blog/admin/
Disallow /blog/comment/reply/
Disallow /blog/filter/tips
Disallow /blog/node/add/
Disallow /blog/search/
Disallow /blog/user/register/
Disallow /blog/user/password/
Disallow /blog/user/login/
Disallow /blog/user/logout/
Disallow /blog/index.php/admin/
Disallow /blog/index.php/comment/reply/
Disallow /blog/index.php/filter/tips
Disallow /blog/index.php/node/add/
Disallow /blog/index.php/search/
Disallow /blog/index.php/user/password/
Disallow /blog/index.php/user/register/
Disallow /blog/index.php/user/login/
Disallow /blog/index.php/user/logout/
Disallow /blog/*?
Disallow /blog/*?cartval=
Disallow /blog/*?cartvalue=
Disallow /blog/taxonomy/term/*
Disallow /contact-us/email-un-subscription
Disallow /ContractTerms
Disallow /blog/category/commercial?page=
Disallow /blog/category/education?page=
Disallow /blog/category/government?page=
Disallow /blog/category/construction?page=
Disallow /blog/category/mobile-office-solutions?page=
Disallow /blog/category/disaster-relief?page=
Disallow /*?page=

gptbot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

chatgpt-user
chatgpt-user/2.0

Rule Path
Allow /

anthropic-ai
claudebot
claude-searchbot
claude-user

Rule Path
Allow /

perplexitybot
perplexity-user

Rule Path
Allow /

google-extended

Rule Path
Allow /

bingbot

Rule Path
Allow /

applebot
applebot-extended

Rule Path
Allow /

amazonbot

Rule Path
Allow /

mistralai-user
cohere-ai
duckassistbot
ai2bot
ccbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://a281323.sitemaphosting6.com/4273199/sitemap.xml

Comments

  • CSS, JS, Images
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • OPENAI
  • ANTHROPIC(Claude)
  • PERPLEXITY
  • GOOGLE(Gemini)
  • MICROSOFT (Bing / Copilot)
  • APPLE
  • AMAZON
  • OTHER NOTABLE AI / RESEARCH CRAWLERS