Skip to content

🌲 use Pino to log within Crawlee

License

Notifications You must be signed in to change notification settings

imyelo/crawlee-pino

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

crawlee-pino

🌲 use Pino to log within Crawlee

Installation

yarn add crawlee-pino

Get Started

  1. Create a Pino logger
import pino from 'pino'

const pinoLogger = pino()
  1. Create a CrawleePino logger
import { CrawleePino } from 'crawlee-pino'

const crawleePinoLogger = new CrawleePino({ pino: pinoLogger })
  1. Assign the logger to Crawlee
import { PuppeteerCrawler, Log } from 'crawlee'

const crawler = new PuppeteerCrawler({
  log: new Log({ logger: crawleePinoLogger }),
})
  1. Run your crawler
await crawler.run(['https://crawlee.dev'])

Full Usage

import pino from 'pino'
import { PuppeteerCrawler, Log } from 'crawlee'
import { CrawleePino } from 'crawlee-pino'

export const logger = pino()

export const crawler = new PuppeteerCrawler({
  log: new Log({
    logger: new CrawleePino({ pino: logger.child({ tag: 'crawlee' }) }),
  }),
})

await crawler.run(['https://crawlee.dev'])

References

License

Apache-2.0 © yelo, 2023 - present