funsubstance.com
robots.txt

Robots Exclusion Standard data for funsubstance.com

Resource Scan

Scan Details

Site Domain funsubstance.com
Base Domain funsubstance.com
Scan Status Ok
Last Scan2024-11-09T19:51:52+00:00
Next Scan 2024-11-16T19:51:52+00:00

Last Scan

Scanned2024-11-09T19:51:52+00:00
URL https://funsubstance.com/robots.txt
Domain IPs 104.21.8.97, 172.67.157.70, 2606:4700:3031::6815:861, 2606:4700:3034::ac43:9d46
Response IP 104.21.8.97
Found Yes
Hash 3bcf56445bf5e78fc2fd67fdf49fd70a2243b7c06991d2e022a429978c8f65c4
SimHash 245d4025bb90

Groups

*

Rule Path
Disallow /post/like/
Disallow /post/unlike
Disallow /fun/like/
Disallow /fun/unlike/
Disallow /comment/like/
Disallow /comment/dislike/
Disallow /discover/
Disallow /new/page/
Disallow /guest/page/
Disallow /page/*/
Disallow /wordpress/
Disallow /user/showviewedposts/
Disallow /wp-login.php*
Disallow /*/vote/*/
Disallow /2010/*/
Disallow /*/likes/
Disallow /user/disablesafemode/
Disallow /index.php?r=*
Disallow /feeds/posts/
Disallow /fun/fbthumb/
Disallow /api/post/list/
Disallow /uploads/*/*-*/*.jpg
Disallow /category/
Disallow *?ref=*
Disallow /report/*
Disallow /deleted*
Disallow /notification/subscribePost/*

mediapartners-google

Rule Path
Disallow

ia_archiver

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /