modernlearners.community
robots.txt
Robots Exclusion Standard data for modernlearners.community
Resource Scan
Scan Details
Site Domain | modernlearners.community |
Base Domain | modernlearners.community |
Scan Status | Ok |
Last Scan | 2025-10-09T19:42:35+00:00 |
Next Scan | 2025-10-16T19:42:35+00:00 |
Last Scan
Scanned | 2025-10-09T19:42:35+00:00 |
URL | https://www.modernlearners.community/robots.txt |
Domain IPs | 104.21.66.7, 172.67.154.119, 2606:4700:3034::ac43:9a77, 2606:4700:3035::6815:4207 |
Response IP | 104.21.66.7 |
Found | Yes |
Hash | 12b83cb162e47ad7ea39c083d7fe6b1a38216cc9d23b61b417264ed0a51f2fcc |
SimHash | bbca40b2bba2 |
Groups
*
Rule | Path |
---|---|
Disallow | /search? |
Disallow | /list? |
Disallow | /sign_in? |
Disallow | /sign_up? |
Disallow | /*?*filters=* |
Disallow | /*comments |
Disallow | /spaces/1229475* |
Disallow | /spaces/21168772* |
Disallow | /spaces/7181366* |
Disallow | /spaces/627828* |
Disallow | /spaces/1425531* |
Disallow | /spaces/21272939* |
Disallow | /spaces/16661738* |
Disallow | /spaces/17481683* |
Disallow | /spaces/1356666* |
Disallow | /spaces/21336777* |
Disallow | /spaces/11889248* |
Disallow | /spaces/985312* |
Disallow | /spaces/2169750* |
Disallow | /spaces/630842* |
Disallow | /spaces/17286022* |
Disallow | /spaces/21218071* |
Disallow | /spaces/16476838* |
Disallow | /spaces/11518639* |
Disallow | /spaces/1425648* |
Disallow | /spaces/21209075* |
Disallow | /spaces/583408* |
Disallow | /spaces/17924320* |
Disallow | /spaces/21184687* |
Disallow | /spaces/17482012* |
Disallow | /spaces/3409270* |
Disallow | /communities/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.modernlearners.community/sitemap.xml |