Skip to content
This repository has been archived by the owner on Jun 7, 2024. It is now read-only.

32-update-crawlerts-add-hostname-check-to-keep-crawler-on-the-same-domain #33

Conversation

athrael-soju
Copy link
Owner

No description provided.

@athrael-soju athrael-soju self-assigned this Oct 9, 2023
@vercel
Copy link

vercel bot commented Oct 9, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
iridium-ai ✅ Ready (Inspect) Visit Preview 💬 Add feedback Oct 9, 2023 2:12pm

@sonarcloud
Copy link

sonarcloud bot commented Oct 9, 2023

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication

@athrael-soju
Copy link
Owner Author

Tested functionality for crawler fixe in pinecone-io/pinecone-vercel-starter#15

Works like a charm. Minor detail here is that I use import { load } from 'cheerio'; as the former approach is deprecated.

@athrael-soju athrael-soju merged commit 813b310 into main Oct 9, 2023
4 checks passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

Update crawler.ts: Add hostname check to keep crawler on the same domain.
1 participant