fuckmoral.com
robots.txt

Robots Exclusion Standard data for fuckmoral.com

Resource Scan

Scan Details

Site Domain fuckmoral.com
Base Domain fuckmoral.com
Scan Status Ok
Last Scan2024-09-15T08:14:05+00:00
Next Scan 2024-10-15T08:14:05+00:00

Last Scan

Scanned2024-09-15T08:14:05+00:00
URL https://fuckmoral.com/robots.txt
Domain IPs 104.21.31.157, 172.67.178.60, 2606:4700:3032::6815:1f9d, 2606:4700:3037::ac43:b23c
Response IP 172.67.178.60
Found Yes
Hash cc7bf3fe13175955a8430f3b118f939bd348a87c3569ed27a8acd5de0c7aea04
SimHash 231dc2e063a4

Groups

*

Rule Path
Disallow /*/video/*
Disallow /*/terms
Disallow /*/privacy
Disallow /*/faq
Disallow /*/dmca
Disallow /*/get-listed
Disallow /*/contact
Disallow /*/liked
Disallow /*/watch-later
Disallow /*/clicked
Disallow /*/*long%3Dlong*
Disallow /*/*order%3Ddate*
Disallow /*/pornstar/*/long*
Disallow /*/pornstar/*/order/date*
Disallow /*/category/*/long*
Disallow /*/category/*/order/date*
Disallow /*/js
Disallow /*/css
Disallow /*/page/
Disallow /*%26page%3D
Disallow /api/*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandexbot

Rule Path
Allow /en
Allow /ru
Allow /tr
Disallow /

Other Records

Field Value
crawl-delay 60

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /