realting.com
robots.txt

Robots Exclusion Standard data for realting.com

Resource Scan

Scan Details

Site Domain realting.com
Base Domain realting.com
Scan Status Ok
Last Scan2024-10-03T15:00:32+00:00
Next Scan 2024-10-10T15:00:32+00:00

Last Scan

Scanned2024-10-03T15:00:32+00:00
URL https://realting.com/robots.txt
Domain IPs 104.21.34.76, 172.67.156.29
Response IP 104.21.34.76
Found Yes
Hash c5378863de1d686820982c892e9803956d15fdeb76d87106bdb9c42ecb43cdd4
SimHash cf1db4a3ce07

Groups

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

*

Rule Path
Disallow */admin
Disallow *user
Disallow /cgi-bin/*
Disallow *account
Disallow /*?
Disallow /*%26
Disallow /*%3D*
Disallow *share/*
Disallow */view-counter*
Disallow */get-form-action*
Disallow */view?id*
Allow *.jpg
Allow *.jpeg
Allow *.ico
Allow *.svg
Allow *.gif
Allow *.png
Allow *.pdf
Allow *.doc
Allow *.docx
Allow *.js
Allow *.css
Allow *.webp
Allow /*?page=*
Allow */news/*