{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":45406338,"defaultBranch":"main","name":"crawler","ownerLogin":"spatie","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2015-11-02T16:22:09.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/7535935?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1707993671.0","currentOid":""},"activityList":{"items":[{"before":"dc32e987d15c394ab5260c5534b23f4f16859d80","after":"b1498b3d9fd5813f0c2a3de5726021a2708494a1","ref":"refs/heads/main","pushedAt":"2024-03-14T13:43:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"wip","shortMessageHtmlLink":"wip"}},{"before":"807d145a3c071dc0e69bb7e6783611e2591f9773","after":"dc32e987d15c394ab5260c5534b23f4f16859d80","ref":"refs/heads/main","pushedAt":"2024-02-15T10:45:04.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Update CHANGELOG","shortMessageHtmlLink":"Update CHANGELOG"}},{"before":"6b1ae973121a13dae0f2a7c8cbb3554838bef39f","after":"807d145a3c071dc0e69bb7e6783611e2591f9773","ref":"refs/heads/main","pushedAt":"2024-02-15T10:40:48.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"Add Laravel/Illuminate 11 Support (#461)\n\n* Add Laravel 11 Support\r\n\r\n* Show Illuminate version in matrix\r\n\r\n* Allow dev versions\r\n\r\n* Exclude Laravel 11 on PHP 8.1\r\n\r\n* Update nicmart/tree to ^0.8","shortMessageHtmlLink":"Add Laravel/Illuminate 11 Support (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2134640761\" data-permission-text=\"Title is private\" data-url=\"https://github.com/spatie/crawler/issues/461\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/spatie/crawler/pull/461/hovercard\" href=\"https://github.com/spatie/crawler/pull/461\">#461</a>)"}},{"before":"48b4fdc87dfbe43212499c7b31ed02e360873374","after":"6b1ae973121a13dae0f2a7c8cbb3554838bef39f","ref":"refs/heads/main","pushedAt":"2024-02-06T19:48:47.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"Fix wording in documentation (#460)","shortMessageHtmlLink":"Fix wording in documentation (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2120897774\" data-permission-text=\"Title is private\" data-url=\"https://github.com/spatie/crawler/issues/460\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/spatie/crawler/pull/460/hovercard\" href=\"https://github.com/spatie/crawler/pull/460\">#460</a>)"}},{"before":"f4958b4f1e10113be2bc8d373afdd7b1d4fe0d72","after":"48b4fdc87dfbe43212499c7b31ed02e360873374","ref":"refs/heads/main","pushedAt":"2024-01-02T08:32:14.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Update CHANGELOG","shortMessageHtmlLink":"Update CHANGELOG"}},{"before":"25c378abad8f10a6ad108d96045a36e96e0b60b7","after":"f4958b4f1e10113be2bc8d373afdd7b1d4fe0d72","ref":"refs/heads/main","pushedAt":"2024-01-02T08:29:35.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"feat: custom link parser (#458)\n\n* feat: allow custom url parsers\r\n\r\nPreviously named LinkAdder\r\n\r\n* fix: removed incorrect type check\r\n\r\n* feat: added sitemap url parser\r\n\r\n* tests: added sitemap url parsing test\r\n\r\n* chore: added readme documentation for custom url parsers\r\n\r\n* Update README.md\r\n\r\n* tests: added more consistent tests with sitemapindex and sitemap childs\r\n\r\n* Fix styling\r\n\r\n* chore: added documentation for the built-in SitemapUrlParser\r\n\r\n---------\r\n\r\nCo-authored-by: Freek Van der Herten <freek@spatie.be>\r\nCo-authored-by: Velka-DEV <Velka-DEV@users.noreply.github.com>","shortMessageHtmlLink":"feat: custom link parser (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2061127298\" data-permission-text=\"Title is private\" data-url=\"https://github.com/spatie/crawler/issues/458\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/spatie/crawler/pull/458/hovercard\" href=\"https://github.com/spatie/crawler/pull/458\">#458</a>)"}},{"before":"8b918c2ab0e6a157ccc436efc2a6d6815c3b5e2a","after":"25c378abad8f10a6ad108d96045a36e96e0b60b7","ref":"refs/heads/main","pushedAt":"2023-12-29T13:10:33.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Update CHANGELOG","shortMessageHtmlLink":"Update CHANGELOG"}},{"before":"3d142829b5634c815ee098a2728283e790d43d2d","after":"8b918c2ab0e6a157ccc436efc2a6d6815c3b5e2a","ref":"refs/heads/main","pushedAt":"2023-12-29T13:08:05.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"allow php 8.3","shortMessageHtmlLink":"allow php 8.3"}},{"before":"ad7a090f8173f23760fa629ee48fa813c1a214c4","after":"3d142829b5634c815ee098a2728283e790d43d2d","ref":"refs/heads/main","pushedAt":"2023-12-29T13:05:33.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"allow browsershot v4","shortMessageHtmlLink":"allow browsershot v4"}},{"before":"08e8b73a7b1c320b5274c3250c974531a8015f73","after":"ad7a090f8173f23760fa629ee48fa813c1a214c4","ref":"refs/heads/main","pushedAt":"2023-12-18T14:27:16.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"Allow Symfony 7.x (#456)","shortMessageHtmlLink":"Allow Symfony 7.x (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2044768390\" data-permission-text=\"Title is private\" data-url=\"https://github.com/spatie/crawler/issues/456\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/spatie/crawler/pull/456/hovercard\" href=\"https://github.com/spatie/crawler/pull/456\">#456</a>)"}},{"before":"6983c78d32d4b4dfab2ead4da3bfc7396a0fa6c5","after":"08e8b73a7b1c320b5274c3250c974531a8015f73","ref":"refs/heads/main","pushedAt":"2023-11-22T12:57:03.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Update CHANGELOG","shortMessageHtmlLink":"Update CHANGELOG"}},{"before":"8cd9920d6487cc106f831f4c4ec7ca17e16545db","after":"6983c78d32d4b4dfab2ead4da3bfc7396a0fa6c5","ref":"refs/heads/main","pushedAt":"2023-11-22T12:56:26.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"Fix return type (#452)","shortMessageHtmlLink":"Fix return type (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2002836951\" data-permission-text=\"Title is private\" data-url=\"https://github.com/spatie/crawler/issues/452\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/spatie/crawler/pull/452/hovercard\" href=\"https://github.com/spatie/crawler/pull/452\">#452</a>)"}},{"before":"62354d296c6112ab4694f594ad620139e3f0fed2","after":"8cd9920d6487cc106f831f4c4ec7ca17e16545db","ref":"refs/heads/main","pushedAt":"2023-11-20T08:05:18.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Update CHANGELOG","shortMessageHtmlLink":"Update CHANGELOG"}},{"before":"1e10b8709ab6311b351e655e7e86e3629c722f69","after":"62354d296c6112ab4694f594ad620139e3f0fed2","ref":"refs/heads/main","pushedAt":"2023-11-20T08:04:52.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Fix styling","shortMessageHtmlLink":"Fix styling"}},{"before":"d7e204a6038637a9b518ef505b0fcb2c6b5c9a7a","after":"1e10b8709ab6311b351e655e7e86e3629c722f69","ref":"refs/heads/main","pushedAt":"2023-11-20T08:04:31.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"Update CrawlObserver.php (#449)","shortMessageHtmlLink":"Update CrawlObserver.php (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2000594769\" data-permission-text=\"Title is private\" data-url=\"https://github.com/spatie/crawler/issues/449\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/spatie/crawler/pull/449/hovercard\" href=\"https://github.com/spatie/crawler/pull/449\">#449</a>)"}},{"before":"ec58bd1c5269066a34ce927b470b31cc57be43fd","after":"d7e204a6038637a9b518ef505b0fcb2c6b5c9a7a","ref":"refs/heads/main","pushedAt":"2023-07-19T18:37:54.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Update CHANGELOG","shortMessageHtmlLink":"Update CHANGELOG"}},{"before":"2af8b93fb1afbc9f9c6c6a4881fe6de30c266cf0","after":"ec58bd1c5269066a34ce927b470b31cc57be43fd","ref":"refs/heads/main","pushedAt":"2023-07-19T18:37:01.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Fix styling","shortMessageHtmlLink":"Fix styling"}},{"before":"4d8058636ebbf18a03abcf13045477cea322a4e3","after":"2af8b93fb1afbc9f9c6c6a4881fe6de30c266cf0","ref":"refs/heads/main","pushedAt":"2023-07-19T18:36:39.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"Check if rel attribute contains nofollow (#445)","shortMessageHtmlLink":"Check if rel attribute contains nofollow (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1811939043\" data-permission-text=\"Title is private\" data-url=\"https://github.com/spatie/crawler/issues/445\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/spatie/crawler/pull/445/hovercard\" href=\"https://github.com/spatie/crawler/pull/445\">#445</a>)"}},{"before":"c848f39a7e810b2d4196ee7532892ca3be525e19","after":"4d8058636ebbf18a03abcf13045477cea322a4e3","ref":"refs/heads/main","pushedAt":"2023-06-04T21:28:53.349Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Fix styling","shortMessageHtmlLink":"Fix styling"}},{"before":"d2d3fcded827c79bf8e5fcfafd7b4ebff8314b77","after":"c848f39a7e810b2d4196ee7532892ca3be525e19","ref":"refs/heads/main","pushedAt":"2023-06-04T21:28:24.217Z","pushType":"push","commitsCount":1,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"Add test case for getting text from an HTML link","shortMessageHtmlLink":"Add test case for getting text from an HTML link"}},{"before":"8d2603a431e40934a0a9fa1836360d9876dc2fbf","after":"d2d3fcded827c79bf8e5fcfafd7b4ebff8314b77","ref":"refs/heads/main","pushedAt":"2023-06-04T12:15:34.469Z","pushType":"push","commitsCount":2,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"Merge branch 'main' of github.com:spatie/crawler","shortMessageHtmlLink":"Merge branch 'main' of github.com:spatie/crawler"}},{"before":"7927a016078c6c5dfbe59aa6d3f436c139f6c4a9","after":"8d2603a431e40934a0a9fa1836360d9876dc2fbf","ref":"refs/heads/main","pushedAt":"2023-06-04T12:05:42.950Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Update CHANGELOG","shortMessageHtmlLink":"Update CHANGELOG"}},{"before":"9f80007468e56645143ae164d8055b1a90ef00c5","after":null,"ref":"refs/heads/add-link-text","pushedAt":"2023-06-04T12:04:44.102Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"}},{"before":"94833d75fa0a2d61cac55b493264189791ed152c","after":"7927a016078c6c5dfbe59aa6d3f436c139f6c4a9","ref":"refs/heads/main","pushedAt":"2023-06-04T12:04:40.614Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"Add link text (#444)\n\n* add-link-text\r\n\r\n* Fix styling\r\n\r\n* Refactor LinkAdder to limit link text length to 4000 characters\r\n\r\n* Add new parameter $linkText to CrawlObserver methods\r\n\r\n* update deps\r\n\r\n* Update README.md\r\n\r\n* Rename and update files to fix PHP code style issues\r\n\r\n* Fix styling\r\n\r\n---------\r\n\r\nCo-authored-by: freekmurze <freekmurze@users.noreply.github.com>","shortMessageHtmlLink":"Add link text (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1740320592\" data-permission-text=\"Title is private\" data-url=\"https://github.com/spatie/crawler/issues/444\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/spatie/crawler/pull/444/hovercard\" href=\"https://github.com/spatie/crawler/pull/444\">#444</a>)"}},{"before":null,"after":"94833d75fa0a2d61cac55b493264189791ed152c","ref":"refs/heads/v7","pushedAt":"2023-06-04T12:04:02.565Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"Update CHANGELOG","shortMessageHtmlLink":"Update CHANGELOG"}},{"before":"effe92988aba15c91a1fa113305caeca826dd842","after":"9f80007468e56645143ae164d8055b1a90ef00c5","ref":"refs/heads/add-link-text","pushedAt":"2023-06-04T11:59:44.567Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Fix styling","shortMessageHtmlLink":"Fix styling"}},{"before":"c3bd07b446ecc34e168197557a27138389107cc1","after":"effe92988aba15c91a1fa113305caeca826dd842","ref":"refs/heads/add-link-text","pushedAt":"2023-06-04T11:58:39.063Z","pushType":"push","commitsCount":2,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"Merge branch 'add-link-text' of github.com:spatie/crawler into add-link-text","shortMessageHtmlLink":"Merge branch 'add-link-text' of github.com:spatie/crawler into add-li…"}},{"before":"d5b3a45b18eb531729848640d3d0ff6a29994829","after":"c3bd07b446ecc34e168197557a27138389107cc1","ref":"refs/heads/add-link-text","pushedAt":"2023-06-04T11:57:43.217Z","pushType":"push","commitsCount":1,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"Update README.md","shortMessageHtmlLink":"Update README.md"}},{"before":"d5d5b1e5c0f7c55765ef1f9847e496de051720fa","after":"d5b3a45b18eb531729848640d3d0ff6a29994829","ref":"refs/heads/add-link-text","pushedAt":"2023-06-04T11:56:57.649Z","pushType":"push","commitsCount":1,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"update deps","shortMessageHtmlLink":"update deps"}},{"before":"1d4850310d1e455643cbde57a896d1d123161576","after":"d5d5b1e5c0f7c55765ef1f9847e496de051720fa","ref":"refs/heads/add-link-text","pushedAt":"2023-06-04T11:54:30.902Z","pushType":"push","commitsCount":1,"pusher":{"login":"freekmurze","name":"Freek Van der Herten","path":"/freekmurze","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/483853?s=80&v=4"},"commit":{"message":"Add new parameter $linkText to CrawlObserver methods","shortMessageHtmlLink":"Add new parameter $linkText to CrawlObserver methods"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEFbB6mgA","startCursor":null,"endCursor":null}},"title":"Activity · spatie/crawler"}