russpain.com
robots.txt

Robots Exclusion Standard data for russpain.com

Resource Scan

Scan Details

Site Domain russpain.com
Base Domain russpain.com
Scan Status Ok
Last Scan2024-06-09T05:36:31+00:00
Next Scan 2024-06-16T05:36:31+00:00

Last Scan

Scanned2024-06-09T05:36:31+00:00
URL https://russpain.com/robots.txt
Domain IPs 104.26.4.130, 104.26.5.130, 172.67.69.87, 2606:4700:20::681a:482, 2606:4700:20::681a:582, 2606:4700:20::ac43:4557
Response IP 104.26.4.130
Found Yes
Hash ca56a37b9f1ebc6eb2b75de08d74b2792476bdb6b5ae338c8939d83a0fda2545
SimHash 0948b4524850

Groups

*

Rule Path
Disallow */a/*
Disallow */%26*
Disallow /*%40*
Disallow /*?wordfence*
Disallow */feed/*
Disallow */author/auth1/page/*
Disallow /*/comment-*
Disallow /wp-*
Disallow /search*
Disallow */add/*
Disallow *delete*
Disallow */edit/*
Disallow */?s=*
Disallow */ans/*
Disallow *%26sort*
Disallow *?sort*
Disallow */vote/*
Disallow */form*
Disallow *?tab*
Disallow */share*
Disallow */embed/*
Disallow */attachment/*
Disallow *id%3D*

yandex

Rule Path
Disallow */amp/*
Disallow */a/*
Disallow */%26*
Disallow /*%40*
Disallow /*?wordfence*
Disallow */feed/*
Disallow /*/comment-*
Disallow /wp-*
Disallow /search*
Disallow */add/*
Disallow *delete*
Disallow */edit/*
Disallow */?s=*
Disallow */ans/*
Disallow *%26sort*
Disallow *?sort*
Disallow */vote/*
Disallow */form*
Disallow *?tab*
Disallow */share*
Disallow */embed/*
Disallow */attachment/*
Disallow *id%3D*

msnbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

barkrowler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3600

Other Records

Field Value
sitemap https://russpain.com/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.