/.well-known/

Log In Sign Up

crawler.com

/.well-known/ resources for crawler.com

Site Scan

Site Details

Site Domain	crawler.com
Base Domain	crawler.com
Added	2021-03-10T15:00:13+00:00
Last Scan	2025-05-28T02:19:03+00:00
Next Scan	2025-08-26T02:19:03+00:00

Found Resources

Resource	Found At	Scan Status
robots.txt	2023-10-14T00:52:03+00:00	Failed

Authorized Digital Sellers

Resource Details

Resource	ads.txt
Status	Failed
Failure Stage	Checking robots.txt.
Failure Reason	Request timed out.
Archive	Check Archive

Scan Requests (4)

URL	https://crawler.com/ads.txt
Result	Failed checking robots.txt - Request timed out.

URL	https://www.crawler.com/ads.txt
Result	Failed checking robots.txt - Request timed out.

URL	http://crawler.com/ads.txt
Result	Failed checking robots.txt - Request timed out.

URL	http://www.crawler.com/ads.txt
Result	Failed checking robots.txt - Request timed out.

Last Successful Scan

Scanned	2023-10-14T00:52:03+00:00
URL	http://crawler.com/ads.txt
Redirect	http://www.crawler.com/ads.txt
Redirect Domain	www.crawler.com
Redirect Base	crawler.com
Domain IPs	64.135.77.50
Redirect IPs	64.135.77.50
Response IP	64.135.77.50
Found	No
Not Found Reason	Resource doesn't exist.

Back to top

Authorized Digital Sellers for Apps

Resource Details

Resource	app-ads.txt
Status	Failed
Failure Stage	Checking robots.txt.
Failure Reason	Request timed out.
Archive	Check Archive

Scan Requests (4)

URL	https://crawler.com/app-ads.txt
Result	Failed checking robots.txt - Request timed out.

URL	https://www.crawler.com/app-ads.txt
Result	Failed checking robots.txt - Request timed out.

URL	http://crawler.com/app-ads.txt
Result	Failed checking robots.txt - Request timed out.

URL	http://www.crawler.com/app-ads.txt
Result	Failed checking robots.txt - Request timed out.

Last Successful Scan

Scanned	2023-10-14T00:52:03+00:00
URL	http://crawler.com/app-ads.txt
Redirect	http://www.crawler.com/app-ads.txt
Redirect Domain	www.crawler.com
Redirect Base	crawler.com
Domain IPs	64.135.77.50
Redirect IPs	64.135.77.50
Response IP	64.135.77.50
Found	No
Not Found Reason	Resource doesn't exist.

Back to top

Apple Associated Domain

Resource Details

Resource	apple-app-site-association
Status	Failed
Failure Stage	Checking robots.txt.
Failure Reason	Request timed out.
Archive	Check Archive

Scan Requests (2)

URL	https://crawler.com/.well-known/apple-app-site-association
Result	Failed checking robots.txt - Request timed out.

URL	https://www.crawler.com/.well-known/apple-app-site-association
Result	Failed checking robots.txt - Request timed out.

Last Successful Scan

Scanned	2022-03-14T20:12:13+00:00
URL	https://crawler.com/.well-known/apple-app-site-association
Redirect	https://www.crawler.com/.well-known/apple-app-site-association
Redirect Domain	www.crawler.com
Redirect Base	crawler.com
Response IP	64.135.77.50
Found	No
Not Found Reason	Request was redirected to another domain.

Back to top

Digital Asset Links

Resource Details

Resource	assetlinks.json
Status	Failed
Failure Stage	Checking robots.txt.
Failure Reason	Request timed out.
Archive	Check Archive

Scan Requests (4)

URL	https://crawler.com/.well-known/assetlinks.json
Result	Failed checking robots.txt - Request timed out.

URL	https://www.crawler.com/.well-known/assetlinks.json
Result	Failed checking robots.txt - Request timed out.

URL	http://crawler.com/.well-known/assetlinks.json
Result	Failed checking robots.txt - Request timed out.

URL	http://www.crawler.com/.well-known/assetlinks.json
Result	Failed checking robots.txt - Request timed out.

Last Successful Scan

Scanned	2023-10-14T00:52:03+00:00
URL	http://crawler.com/.well-known/assetlinks.json
Redirect	http://www.crawler.com/.well-known/assetlinks.json
Redirect Domain	www.crawler.com
Redirect Base	crawler.com
Domain IPs	64.135.77.50
Redirect IPs	64.135.77.50
Response IP	64.135.77.50
Found	No
Not Found Reason	Resource doesn't exist.

Back to top

Global Privacy Control

Resource Details

Resource	gpc.json
Status	Failed
Failure Stage	Checking robots.txt.
Failure Reason	Request timed out.
Archive	Check Archive

Scan Requests (4)

URL	https://crawler.com/.well-known/gpc.json
Result	Failed checking robots.txt - Request timed out.

URL	https://www.crawler.com/.well-known/gpc.json
Result	Failed checking robots.txt - Request timed out.

URL	http://crawler.com/.well-known/gpc.json
Result	Failed checking robots.txt - Request timed out.

URL	http://www.crawler.com/.well-known/gpc.json
Result	Failed checking robots.txt - Request timed out.

Last Successful Scan

Scanned	2023-10-14T00:52:03+00:00
URL	http://crawler.com/.well-known/gpc.json
Redirect	http://www.crawler.com/.well-known/gpc.json
Redirect Domain	www.crawler.com
Redirect Base	crawler.com
Domain IPs	64.135.77.50
Redirect IPs	64.135.77.50
Response IP	64.135.77.50
Found	No
Not Found Reason	Resource doesn't exist.

Back to top

NodeInfo

Resource Details

Resource	nodeinfo
Status	Failed
Failure Stage	Checking robots.txt.
Failure Reason	Request timed out.
Archive	Check Archive

Scan Requests (4)

URL	https://crawler.com/.well-known/nodeinfo
Result	Failed checking robots.txt - Request timed out.

URL	https://www.crawler.com/.well-known/nodeinfo
Result	Failed checking robots.txt - Request timed out.

URL	http://crawler.com/.well-known/nodeinfo
Result	Failed checking robots.txt - Request timed out.

URL	http://www.crawler.com/.well-known/nodeinfo
Result	Failed checking robots.txt - Request timed out.

Last Successful Scan

Scanned	2023-10-14T00:52:03+00:00
URL	http://crawler.com/.well-known/nodeinfo
Redirect	http://www.crawler.com/.well-known/nodeinfo
Redirect Domain	www.crawler.com
Redirect Base	crawler.com
Domain IPs	64.135.77.50
Redirect IPs	64.135.77.50
Response IP	64.135.77.50
Found	No
Not Found Reason	Resource doesn't exist.

Back to top

OpenID Provider Configuration

Resource Details

Resource	openid-configuration
Status	Failed
Failure Stage	Checking robots.txt.
Failure Reason	Request timed out.
Archive	Check Archive

Scan Requests (2)

URL	https://crawler.com/.well-known/openid-configuration
Result	Failed checking robots.txt - Request timed out.

URL	https://www.crawler.com/.well-known/openid-configuration
Result	Failed checking robots.txt - Request timed out.

Last Successful Scan

Scanned	2022-03-14T20:12:13+00:00
URL	https://crawler.com/.well-known/openid-configuration
Redirect	https://www.crawler.com/.well-known/openid-configuration
Redirect Domain	www.crawler.com
Redirect Base	crawler.com
Response IP	64.135.77.50
Found	No
Not Found Reason	Resource doesn't exist.

Back to top

Robots Exclusion Standard

Resource Details

Resource	robots.txt
Status	Failed
Failure Reason	Scan timed out.
Archive	Check Archive

Last Successful Scan

Scanned	2023-10-14T00:52:03+00:00
URL	http://crawler.com/robots.txt
Redirect	http://www.crawler.com/robots.txt
Redirect Domain	www.crawler.com
Redirect Base	crawler.com
Domain IPs	64.135.77.50
Redirect IPs	64.135.77.50
Response IP	64.135.77.50
Found	Yes - View Resource
Hash	58fbdff1ebc91c4dddd89d9a1a2edcdb14edd7ff2bd23b54756c21732be4da43
SimHash	6706b8e1efb4

Back to top

security.txt

Resource Details

Resource	security.txt
Status	Failed
Failure Stage	Checking robots.txt.
Failure Reason	Request timed out.
Archive	Check Archive

Scan Requests (2)

URL	https://crawler.com/.well-known/security.txt
Result	Failed checking robots.txt - Request timed out.

URL	https://www.crawler.com/.well-known/security.txt
Result	Failed checking robots.txt - Request timed out.

Last Successful Scan

Scanned	2022-03-14T20:12:13+00:00
URL	https://crawler.com/.well-known/security.txt
Redirect	https://www.crawler.com/.well-known/security.txt
Redirect Domain	www.crawler.com
Redirect Base	crawler.com
Response IP	64.135.77.50
Found	No
Not Found Reason	Resource doesn't exist.

Back to top

trust.txt

Resource Details

Resource	trust.txt
Status	Failed
Failure Stage	Checking robots.txt.
Failure Reason	Request timed out.
Archive	Check Archive

Scan Requests (4)

URL	https://crawler.com/.well-known/trust.txt
Result	Failed checking robots.txt - Request timed out.

URL	https://www.crawler.com/.well-known/trust.txt
Result	Failed checking robots.txt - Request timed out.

URL	http://crawler.com/.well-known/trust.txt
Result	Failed checking robots.txt - Request timed out.

URL	http://www.crawler.com/.well-known/trust.txt
Result	Failed checking robots.txt - Request timed out.

Last Successful Scan

Scanned	2023-10-14T00:52:03+00:00
URL	http://crawler.com/.well-known/trust.txt
Redirect	http://www.crawler.com/.well-known/trust.txt
Redirect Domain	www.crawler.com
Redirect Base	crawler.com
Domain IPs	64.135.77.50
Redirect IPs	64.135.77.50
Response IP	64.135.77.50
Found	No
Not Found Reason	Resource doesn't exist.

Back to top