fr.mobexer.com
robots.txt

Robots Exclusion Standard data for fr.mobexer.com

Resource Scan

Scan Details

Site Domain fr.mobexer.com
Base Domain mobexer.com
Scan Status Ok
Last Scan2026-04-06T01:49:44+00:00
Next Scan 2026-05-06T01:49:44+00:00

Last Scan

Scanned2026-04-06T01:49:44+00:00
URL https://fr.mobexer.com/robots.txt
Domain IPs 104.18.4.90, 104.18.5.90, 2606:4700::6812:45a, 2606:4700::6812:55a
Response IP 104.18.5.90
Found Yes
Hash c866df2e8d21e6ef870a96f1f62f3731e84247888a3606d5cb69921a17a796c7
SimHash 590c8813ef91

Groups

ias_crawler
ias_wombles

Rule Path
Allow /

*

Rule Path
Disallow /?download=*
Disallow /?s=*

baiduspider*
sogou*

Rule Path
Disallow /

ahrefsbot
blexbot
ccbot
cliqzbot
dotbot
ia_archiver
mbcrawler
mj12bot
photon
scrapy
semrushbot
linguee

Rule Path
Disallow /

Other Records

Field Value
sitemap https://fr.mobexer.com/sitemaps/sitemap.xml