turking.online
robots.txt

Robots Exclusion Standard data for turking.online

Resource Scan

Scan Details

Site Domain turking.online
Base Domain turking.online
Scan Status Ok
Last Scan2024-10-07T15:19:11+00:00
Next Scan 2024-10-14T15:19:11+00:00

Last Scan

Scanned2024-10-07T15:19:11+00:00
URL https://turking.online/robots.txt
Domain IPs 104.21.78.178, 172.67.136.38, 2606:4700:3032::6815:4eb2, 2606:4700:3036::ac43:8826
Response IP 104.21.78.178
Found Yes
Hash 88e4a68a0475a366403ae9a7f774fb6a0f126427895ef6d3390c037742ca2c58
SimHash 7d01b4721131

Groups

*

Rule Path
Allow /engine/classes/min/*
Allow /engine/classes/js/*
Allow /engine/data/emoticons/*
Disallow /engine/
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow */page/*
Disallow /xfsearch/*
Disallow */?*

Other Records

Field Value
sitemap https://turking.online/sitemap.xml

Warnings

  • `host` is not a known field.