如何在App Engine Flex Java环境中使用Stackdriver Structured日志记录 [英] How to use Stackdriver Structured Logging in App Engine Flex Java environment

问题描述

Google App Engine灵活的环境会自动将stdout和stderr传递到Stackdriver(Google Cloud Logging).但这仅支持不带任何元数据的纯文本日志消息(甚至不包括日志级别).

Google App Engine flexible environment automatically pipes stdout and stderr to Stackdriver (Google Cloud Logging). But this only supports plain text log message without any metadata (not even logging levels).

我找到了用于Google云日志记录的Logback附加程序.

I found Logback appender for google cloud logging.

https://cloud.google.com/logging/docs/setup/java

但是，这似乎还不支持结构化日志记录. 而且，它还可以对幕后的每个日志条目进行GRPC调用.因此，我想知道它的可伸缩性(尤其是与具有单独Fluentd代理处理日志的当前应用程序引擎结构相比).

But this does not seem to support structured logging yet. And also, it makes GRPC calls for every log entry under the hood. So, I wonder how scalable it is (especially compare to current app engine structure which has separate Fluentd agent handles logs).

是否有任何现成的或简单的解决方案可将结构化日志从App Engine发送到Stackdriver?

Is there any out of box or simple solution to send structured log from App Engine to Stackdriver?

推荐答案

您可以使用Logback附加程序+实施 LoggingEnhacer

You could use the Logback appender + Implement LoggingEnhacer

public class LogEnhancer implements LoggingEnhancer {


  @Override
  public void enhanceLogEntry(LogEntry.Builder logEntry) {
    // add Labels
    logEntry.addLabel("project", "conversational-services");

    // Transform textPayload to JSONPayload
    ObjectMapper mapper = new ObjectMapper();
    Builder structBuilder = Struct.newBuilder();
    String textPayload = logEntry.build().getPayload().getData().toString();
    try {
      // Validate JSON Payload
      mapper.readTree(textPayload);
      JsonFormat.parser().merge(textPayload, structBuilder);
      logEntry.setPayload(JsonPayload.of(structBuilder.build()));
    } catch (InvalidProtocolBufferException e) {
      // Error reporting an error! FML
      System.err.println(e.getMessage());
    } catch (IOException e) {
      // Do nothing (there is not a JSON Payload)
    }

  }

}

此类添加标签并在JSONPayload中转换JSON字符串

This class add labels and transform a JSON String in a JSONPayload

您需要在 logback.xml 文件

<!DOCTYPE configuration>
<configuration>
  <appender name="CLOUD" class="com.google.cloud.logging.logback.LoggingAppender">

    <filter class="ch.qos.logback.classic.filter.ThresholdFilter">
      <level>INFO</level>
    </filter>
    <log>application.log</log> 
    <resourceType>gae_app</resourceType> 
    <!--  References to the LoggingEnhacer class -->
     <enhancer>[path_for_your_logging_enhancer_class]</enhancer>
    <flushLevel>WARN</flushLevel> 
  </appender>

  <root level="info">
    <appender-ref ref="CLOUD" />
  </root>
</configuration>

这篇关于如何在App Engine Flex Java环境中使用Stackdriver Structured日志记录的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！