gayspeak.com
robots.txt

Robots Exclusion Standard data for gayspeak.com

Resource Scan

Scan Details

Site Domain gayspeak.com
Base Domain gayspeak.com
Scan Status Ok
Last Scan2024-05-23T16:38:33+00:00
Next Scan 2024-06-22T16:38:33+00:00

Last Scan

Scanned2024-05-23T16:38:33+00:00
URL https://gayspeak.com/robots.txt
Domain IPs 104.21.10.169, 172.67.146.32
Response IP 172.67.146.32
Found Yes
Hash 9f74f26ae9e8c4adada8e92b394212feca3c4734a76a8ec4be45609a360acee5
SimHash 041d4c710a87

Groups

twiceler

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /archive
Disallow /image
Disallow /jscripts
Disallow /calendar
Disallow /attachment.php
Disallow /captcha.php
Disallow /editpost.php
Disallow /member.php
Disallow /memberlist.php
Disallow /misc.php
Disallow /modcp.php
Disallow /moderation.php
Disallow /newreply.php
Disallow /newthread.php
Disallow /online.php
Disallow /private.php
Disallow /printthread.php
Disallow /ratethread.php
Disallow /report.php
Disallow /search.php
Disallow /sendthread.php
Disallow /task.php
Disallow /usercp.php
Disallow /usercp2.php

Other Records

Field Value
sitemap https://gayspeak.com/sitemap-index.xml