Log In Sign Up

fdmr.icu
robots.txt

Robots Exclusion Standard data for fdmr.icu

Resource Scan

Scan Details

Site Domain fdmr.icu
Base Domain fdmr.icu
Scan Status Ok
Last Scan2024-11-12T20:25:30+00:00
Next Scan 2024-11-19T20:25:30+00:00

Last Scan

Scanned2024-11-12T20:25:30+00:00
URL https://fdmr.icu/robots.txt
Domain IPs 104.26.14.133, 104.26.15.133, 172.67.69.24, 2606:4700:20::681a:e85, 2606:4700:20::681a:f85, 2606:4700:20::ac43:4518
Response IP 104.26.15.133
Found Yes
Hash 11b6e1e8c347825712311965ce8a6b1fa6ce4736da9a9469b1c703e99074ea25
SimHash 045e4c42cf9b

Groups

*

Rule Path
Allow /
Disallow /download/
Disallow /preview/
Disallow /counter.php?key=*
Disallow /cdn-cgi/
Disallow /search.php
Disallow /ajax_results.php
Disallow /en/search.php
Disallow /en/ajax_results.php
Disallow /transli.php
Disallow /counter2.php
Disallow /ajax_index.php
Disallow /ajax_view.php
Disallow /autocomplete.php

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

moz

Rule Path
Disallow /

majestic

Rule Path
Disallow /

screaming frog

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

majestic12

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

octoparse

Rule Path
Disallow /

httrack

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

webz.io

Rule Path
Disallow /

uipath

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://fdmr.icu/sitemap.xml
Back to top

Comments

  • Block specific SEO bots
  • Additional bots to consider blocking
Back to top