-
Notifications
You must be signed in to change notification settings - Fork 451
feat: add logs:edge-functions command and historical log support #7944
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 14 commits
2c150f2
5cc55d0
ac91779
ccab490
37ed35c
ce57478
5234215
0d7844f
06e3ce5
bd52070
752c16a
a79f5d9
1c399d7
0ba377a
82bd7e5
06bffb4
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,98 @@ | ||
| import { OptionValues } from 'commander' | ||
| import inquirer from 'inquirer' | ||
|
|
||
| import { chalk, log } from '../../utils/command-helpers.js' | ||
| import { getWebSocket } from '../../utils/websockets/index.js' | ||
| import type BaseCommand from '../base-command.js' | ||
|
|
||
| import { parseDateToMs, buildEdgeFunctionLogsUrl, fetchHistoricalLogs, printHistoricalLogs, formatLogEntry } from './log-api.js' | ||
| import { CLI_LOG_LEVEL_CHOICES_STRING, LOG_LEVELS_LIST } from './log-levels.js' | ||
| import { getName } from './build.js' | ||
|
|
||
| export const logsEdgeFunction = async (options: OptionValues, command: BaseCommand) => { | ||
| let deployId = options.deployId as string | undefined | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Also applies to: 32-39 🤖 Prompt for AI Agents |
||
| await command.authenticate() | ||
|
|
||
| const client = command.netlify.api | ||
| const { site } = command.netlify | ||
| const { id: siteId } = site | ||
|
|
||
| if (!siteId) { | ||
| log('You must link a project before attempting to view edge function logs') | ||
| return | ||
| } | ||
|
|
||
| const levels = options.level as string[] | undefined | ||
| if (levels && !levels.every((level) => LOG_LEVELS_LIST.includes(level))) { | ||
| log(`Invalid log level. Choices are:${CLI_LOG_LEVEL_CHOICES_STRING.join(',')}`) | ||
| } | ||
|
|
||
| const levelsToPrint: string[] = levels || LOG_LEVELS_LIST | ||
|
|
||
| if (options.from) { | ||
| const fromMs = parseDateToMs(options.from as string) | ||
| const toMs = options.to ? parseDateToMs(options.to as string) : Date.now() | ||
|
|
||
| const url = buildEdgeFunctionLogsUrl({ siteId, from: fromMs, to: toMs }) | ||
| const data = await fetchHistoricalLogs({ url, accessToken: client.accessToken ?? '' }) | ||
| printHistoricalLogs(data, levelsToPrint) | ||
| return | ||
| } | ||
|
|
||
| const userId = command.netlify.globalConfig.get('userId') as string | ||
|
|
||
| if (!deployId) { | ||
| const deploys = await client.listSiteDeploys({ siteId }) | ||
|
|
||
| if (deploys.length === 0) { | ||
| log('No deploys found for the project') | ||
| return | ||
| } | ||
|
|
||
| if (deploys.length === 1) { | ||
| deployId = deploys[0].id | ||
| } else { | ||
| const { result } = (await inquirer.prompt({ | ||
| name: 'result', | ||
| type: 'list', | ||
| message: `Select a deploy\n\n${chalk.yellow('*')} indicates a deploy created by you`, | ||
| choices: deploys.map((deploy) => ({ | ||
| name: getName({ deploy, userId }), | ||
| value: deploy.id, | ||
| })), | ||
| })) as { result: string } | ||
|
|
||
| deployId = result | ||
| } | ||
| } | ||
|
|
||
| const ws = getWebSocket('wss://socketeer.services.netlify.com/edge-function/logs') | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Side note: I hate that we're exposing this. We should set up a customer-facing domain name for this. |
||
|
|
||
| ws.on('open', () => { | ||
| ws.send( | ||
| JSON.stringify({ | ||
| deploy_id: deployId, | ||
| site_id: siteId, | ||
| access_token: client.accessToken, | ||
| since: new Date().toISOString(), | ||
| }), | ||
| ) | ||
| }) | ||
|
|
||
| ws.on('message', (data: string) => { | ||
| const logData = JSON.parse(data) as { level: string; message: string; timestamp?: string } | ||
| if (!levelsToPrint.includes(logData.level.toLowerCase())) { | ||
| return | ||
| } | ||
| log(formatLogEntry(logData)) | ||
| }) | ||
|
Comment on lines
+88
to
+94
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Guard websocket parsing to prevent command crashes. Line 89 assumes every frame is valid JSON; one malformed payload will throw and terminate the stream. 🛡️ Proposed defensive parsing ws.on('message', (data: string) => {
- const logData = JSON.parse(data) as { level: string; message: string; timestamp?: string }
+ let logData: { level: string; message: string; timestamp?: string }
+ try {
+ logData = JSON.parse(data) as { level: string; message: string; timestamp?: string }
+ } catch {
+ log('Received malformed log payload')
+ return
+ }
+
if (!levelsToPrint.includes(logData.level.toLowerCase())) {
return
}
log(formatLogEntry(logData))
})🤖 Prompt for AI Agents |
||
|
|
||
| ws.on('close', () => { | ||
| log('Connection closed') | ||
| }) | ||
|
|
||
| ws.on('error', (err: Error) => { | ||
| log('Connection error') | ||
| log(err.message) | ||
| }) | ||
| } | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -5,6 +5,7 @@ import { chalk, log } from '../../utils/command-helpers.js' | |
| import { getWebSocket } from '../../utils/websockets/index.js' | ||
| import type BaseCommand from '../base-command.js' | ||
|
|
||
| import { parseDateToMs, buildFunctionLogsUrl, fetchHistoricalLogs, printHistoricalLogs } from './log-api.js' | ||
| import { CLI_LOG_LEVEL_CHOICES_STRING, LOG_LEVELS, LOG_LEVELS_LIST } from './log-levels.js' | ||
|
|
||
| function getLog(logData: { level: string; message: string }) { | ||
|
|
@@ -28,27 +29,41 @@ function getLog(logData: { level: string; message: string }) { | |
| } | ||
|
|
||
| export const logsFunction = async (functionName: string | undefined, options: OptionValues, command: BaseCommand) => { | ||
| await command.authenticate() | ||
|
|
||
| const client = command.netlify.api | ||
| const { site } = command.netlify | ||
| const { site, siteInfo } = command.netlify | ||
| const { id: siteId } = site | ||
|
|
||
| if (!siteId) { | ||
| log('You must link a project before attempting to view function logs') | ||
| return | ||
| } | ||
|
|
||
| if (options.level && !options.level.every((level: string) => LOG_LEVELS_LIST.includes(level))) { | ||
| log(`Invalid log level. Choices are:${CLI_LOG_LEVEL_CHOICES_STRING}`) | ||
| } | ||
|
|
||
| const levelsToPrint = options.level || LOG_LEVELS_LIST | ||
|
|
||
| // TODO: Update type once the open api spec is updated https://open-api.netlify.com/#tag/function/operation/searchSiteFunctions | ||
| const { functions = [] } = (await client.searchSiteFunctions({ siteId: siteId! })) as any | ||
| let functions: any[] | ||
| if (options.deployId) { | ||
| const deploy = (await client.getSiteDeploy({ siteId: siteId, deployId: options.deployId })) as any | ||
| functions = deploy.available_functions ?? [] | ||
| } else { | ||
| // TODO: Update type once the open api spec is updated https://open-api.netlify.com/#tag/function/operation/searchSiteFunctions | ||
| const result = (await client.searchSiteFunctions({ siteId: siteId })) as any | ||
| functions = result.functions ?? [] | ||
| } | ||
|
Comment on lines
+50
to
+57
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Keep deploy-scoped historical lookups on the deploy's branch. The Also applies to: 85-92 🤖 Prompt for AI Agents |
||
|
|
||
| if (functions.length === 0) { | ||
| log(`No functions found for the project`) | ||
| log(`No functions found for the ${options.deployId ? 'deploy' : 'project'}`) | ||
| return | ||
| } | ||
|
|
||
| let selectedFunction | ||
| if (functionName) { | ||
| selectedFunction = functions.find((fn: any) => fn.n === functionName) | ||
| selectedFunction = functions.find((fn: any) => fn.n === functionName || fn.oid === functionName) | ||
| } else { | ||
| const { result } = await inquirer.prompt({ | ||
| name: 'result', | ||
|
|
@@ -65,7 +80,18 @@ export const logsFunction = async (functionName: string | undefined, options: Op | |
| return | ||
| } | ||
|
|
||
| const { a: accountId, oid: functionId } = selectedFunction | ||
| const { a: accountId, n: resolvedFunctionName, oid: functionId } = selectedFunction | ||
|
|
||
| if (options.from) { | ||
| const fromMs = parseDateToMs(options.from) | ||
| const toMs = options.to ? parseDateToMs(options.to) : Date.now() | ||
| const branch = siteInfo.build_settings?.repo_branch ?? 'main' | ||
|
|
||
| const url = buildFunctionLogsUrl({ siteId, branch, functionName: resolvedFunctionName, from: fromMs, to: toMs }) | ||
| const data = await fetchHistoricalLogs({ url, accessToken: client.accessToken ?? '' }) | ||
| printHistoricalLogs(data, levelsToPrint) | ||
| return | ||
| } | ||
|
|
||
| const ws = getWebSocket('wss://socketeer.services.netlify.com/function/logs') | ||
|
|
||
|
|
||
Uh oh!
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I understand why this is plural and
logs:functionis singular, but it still itches! 😖In the future, I think we could rename
logs:functiontologs:functionsand start accepting multiple function names, since there's nothing stopping us from listening to different streams and interleaving them, just like we do with edge functions.