Log In Sign Up

crawlson.com

/.well-known/ resources for crawlson.com

Site Scan

Site Details

Site Domain crawlson.com
Base Domain crawlson.com
Added2022-08-17T08:28:05+00:00
Last Scan2025-09-24T23:05:12+00:00
Next Scan 2025-11-23T23:05:12+00:00

Found Resources

Resource Found At Scan Status
robots.txt 2025-07-04T22:36:53+00:00 Failed

Authorized Digital Sellers

Resource Details

Resource ads.txt
StatusFailed
Failure StageChecking robots.txt.
Failure ReasonServer returned a server error.
Archive Check Archive

Scan Requests (2)

URL https://crawlson.com/ads.txt
ResultFailed checking robots.txt - Request timed out.
URL https://www.crawlson.com/ads.txt
ResultFailed checking robots.txt - Server returned a server error.

Last Successful Scan

Scanned2025-07-04T22:36:53+00:00
URL https://crawlson.com/ads.txt
Redirect https://www.crawlson.com/ads.txt
Redirect Domain www.crawlson.com
Redirect Base crawlson.com
Domain IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Redirect IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Response IP 172.67.191.49
FoundNo
Not Found ReasonResource doesn't exist.
Back to top

Authorized Digital Sellers for Apps

Resource Details

Resource app-ads.txt
StatusFailed
Failure StageChecking robots.txt.
Failure ReasonServer returned a server error.
Archive Check Archive

Scan Requests (2)

URL https://crawlson.com/app-ads.txt
ResultFailed checking robots.txt - Request timed out.
URL https://www.crawlson.com/app-ads.txt
ResultFailed checking robots.txt - Server returned a server error.

Last Successful Scan

Scanned2025-07-04T22:36:53+00:00
URL https://crawlson.com/app-ads.txt
Redirect https://www.crawlson.com/app-ads.txt
Redirect Domain www.crawlson.com
Redirect Base crawlson.com
Domain IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Redirect IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Response IP 104.21.49.158
FoundNo
Not Found ReasonResource doesn't exist.
Back to top

Apple Associated Domain

Resource Details

Resource apple-app-site-association
StatusFailed
Failure StageChecking robots.txt.
Failure ReasonServer returned a server error.
Archive Check Archive

Scan Requests (2)

URL https://crawlson.com/.well-known/apple-app-site-association
ResultFailed checking robots.txt - Request timed out.
URL https://www.crawlson.com/.well-known/apple-app-site-association
ResultFailed checking robots.txt - Server returned a server error.

Last Successful Scan

Scanned2025-07-04T22:36:53+00:00
URL https://crawlson.com/.well-known/apple-app-site-association
Redirect https://www.crawlson.com/.well-known/apple-app-site-association
Redirect Domain www.crawlson.com
Redirect Base crawlson.com
Domain IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Redirect IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Response IP 104.21.49.158
FoundNo
Not Found ReasonResource doesn't exist.
Back to top

Resource Details

Resource assetlinks.json
StatusFailed
Failure StageChecking robots.txt.
Failure ReasonServer returned a server error.
Archive Check Archive

Scan Requests (2)

URL https://crawlson.com/.well-known/assetlinks.json
ResultFailed checking robots.txt - Request timed out.
URL https://www.crawlson.com/.well-known/assetlinks.json
ResultFailed checking robots.txt - Server returned a server error.

Last Successful Scan

Scanned2025-07-04T22:36:53+00:00
URL https://crawlson.com/.well-known/assetlinks.json
Redirect https://www.crawlson.com/.well-known/assetlinks.json
Redirect Domain www.crawlson.com
Redirect Base crawlson.com
Domain IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Redirect IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Response IP 172.67.191.49
FoundNo
Not Found ReasonResource doesn't exist.
Back to top

Global Privacy Control

Resource Details

Resource gpc.json
StatusFailed
Failure StageChecking robots.txt.
Failure ReasonServer returned a server error.
Archive Check Archive

Scan Requests (2)

URL https://crawlson.com/.well-known/gpc.json
ResultFailed checking robots.txt - Request timed out.
URL https://www.crawlson.com/.well-known/gpc.json
ResultFailed checking robots.txt - Server returned a server error.

Last Successful Scan

Scanned2025-07-04T22:36:53+00:00
URL https://crawlson.com/.well-known/gpc.json
Redirect https://www.crawlson.com/.well-known/gpc.json
Redirect Domain www.crawlson.com
Redirect Base crawlson.com
Domain IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Redirect IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Response IP 172.67.191.49
FoundNo
Not Found ReasonResource doesn't exist.
Back to top

NodeInfo

Resource Details

Resource nodeinfo
StatusFailed
Failure StageChecking robots.txt.
Failure ReasonServer returned a server error.
Archive Check Archive

Scan Requests (2)

URL https://crawlson.com/.well-known/nodeinfo
ResultFailed checking robots.txt - Request timed out.
URL https://www.crawlson.com/.well-known/nodeinfo
ResultFailed checking robots.txt - Server returned a server error.

Last Successful Scan

Scanned2025-07-04T22:36:53+00:00
URL https://crawlson.com/.well-known/nodeinfo
Redirect https://www.crawlson.com/.well-known/nodeinfo
Redirect Domain www.crawlson.com
Redirect Base crawlson.com
Domain IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Redirect IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Response IP 104.21.49.158
FoundNo
Not Found ReasonResource doesn't exist.
Back to top

OpenID Provider Configuration

Resource Details

Resource openid-configuration
StatusFailed
Failure StageChecking robots.txt.
Failure ReasonServer returned a server error.
Archive Check Archive

Scan Requests (2)

URL https://crawlson.com/.well-known/openid-configuration
ResultFailed checking robots.txt - Request timed out.
URL https://www.crawlson.com/.well-known/openid-configuration
ResultFailed checking robots.txt - Server returned a server error.

Last Successful Scan

Scanned2025-07-04T22:36:53+00:00
URL https://crawlson.com/.well-known/openid-configuration
Redirect https://www.crawlson.com/.well-known/openid-configuration
Redirect Domain www.crawlson.com
Redirect Base crawlson.com
Domain IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Redirect IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Response IP 104.21.49.158
FoundNo
Not Found ReasonResource doesn't exist.
Back to top

Robots Exclusion Standard

Resource Details

Resource robots.txt
StatusFailed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Archive Check Archive

Scan Requests (2)

URL https://crawlson.com/robots.txt
ResultFailed fetching resource - Request timed out.
URL https://www.crawlson.com/robots.txt
ResultFailed fetching resource - Server returned a server error (502).

Last Successful Scan

Scanned2025-07-04T22:36:53+00:00
URL https://crawlson.com/robots.txt
Redirect https://www.crawlson.com/robots.txt
Redirect Domain www.crawlson.com
Redirect Base crawlson.com
Domain IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Redirect IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Response IP 172.67.191.49
Found Yes - View Resource
Hash ec4f62d5a77ebf318f4a6344b36ff448d3d2d12f583af606f9bf23a20b0f2ff8
SimHash 8d2dd820c190
Back to top

security.txt

Resource Details

Resource security.txt
StatusFailed
Failure StageChecking robots.txt.
Failure ReasonServer returned a server error.
Archive Check Archive

Scan Requests (2)

URL https://crawlson.com/.well-known/security.txt
ResultFailed checking robots.txt - Request timed out.
URL https://www.crawlson.com/.well-known/security.txt
ResultFailed checking robots.txt - Server returned a server error.

Last Successful Scan

Scanned2025-07-04T22:36:53+00:00
URL https://crawlson.com/.well-known/security.txt
Redirect https://www.crawlson.com/.well-known/security.txt
Redirect Domain www.crawlson.com
Redirect Base crawlson.com
Domain IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Redirect IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Response IP 104.21.49.158
FoundNo
Not Found ReasonResource doesn't exist.
Back to top

trust.txt

Resource Details

Resource trust.txt
StatusFailed
Failure StageChecking robots.txt.
Failure ReasonServer returned a server error.
Archive Check Archive

Scan Requests (2)

URL https://crawlson.com/.well-known/trust.txt
ResultFailed checking robots.txt - Request timed out.
URL https://www.crawlson.com/.well-known/trust.txt
ResultFailed checking robots.txt - Server returned a server error.

Last Successful Scan

Scanned2025-07-04T22:36:53+00:00
URL https://crawlson.com/.well-known/trust.txt
Redirect https://www.crawlson.com/.well-known/trust.txt
Redirect Domain www.crawlson.com
Redirect Base crawlson.com
Domain IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Redirect IPs 104.21.49.158, 172.67.191.49, 2606:4700:3032::6815:319e, 2606:4700:3035::ac43:bf31
Response IP 172.67.191.49
FoundNo
Not Found ReasonResource doesn't exist.
Back to top