ooni-probe-cli/internal/engine/netx
Simone Basso fc19c9901a
fix(webconnectivity): expose network events (#258)
* fix(webconnectivity): expose network events

By not exposing network events in webconnectivity, we are missing
several interesting, explanatory data points.

This diff fixes the issue by:

1. enriching the definition of network events to include extra
data useful for performing (manual) data analysis;

2. adding a tags field to network events such that we can add
tags to specific events and understand where they come from;

3. exposing all the (tagged) network events that happen when running
a webconnectivity experiment.

See https://github.com/ooni/probe-engine/issues/1157.

* progress

* more work towards landing this diff

* Apply suggestions from code review
2021-03-23 16:46:46 +01:00
..
archival fix(webconnectivity): expose network events (#258) 2021-03-23 16:46:46 +01:00
bytecounter chore: merge probe-engine into probe-cli (#201) 2021-02-02 12:05:47 +01:00
dialer Release 3.6.0 (#239) 2021-03-03 14:42:17 +01:00
errorx chore: merge probe-engine into probe-cli (#201) 2021-02-02 12:05:47 +01:00
gocertifi feat(ooapi): add toplevel client and simplify API (#248) 2021-03-19 09:30:42 +01:00
httptransport fix(http body saver): properly deal with EOF terminated bodies (#226) 2021-02-11 14:57:14 +01:00
quicdialer Release 3.6.0 (#239) 2021-03-03 14:42:17 +01:00
resolver Release 3.6.0 (#239) 2021-03-03 14:42:17 +01:00
selfcensor chore: merge probe-engine into probe-cli (#201) 2021-02-02 12:05:47 +01:00
trace chore: merge probe-engine into probe-cli (#201) 2021-02-02 12:05:47 +01:00
fake_test.go chore: merge probe-engine into probe-cli (#201) 2021-02-02 12:05:47 +01:00
integration_test.go chore: merge probe-engine into probe-cli (#201) 2021-02-02 12:05:47 +01:00
netx_internal_test.go chore: merge probe-engine into probe-cli (#201) 2021-02-02 12:05:47 +01:00
netx_test.go fix(webconnectivity): allow measuring https://1.1.1.1 (#241) 2021-03-08 12:05:43 +01:00
netx.go fix(webconnectivity): allow measuring https://1.1.1.1 (#241) 2021-03-08 12:05:43 +01:00
README.md chore: merge probe-engine into probe-cli (#201) 2021-02-02 12:05:47 +01:00

Package github.com/ooni/probe-engine/netx

OONI extensions to the net and net/http packages. This code is used by ooni/probe-engine as a low level library to collect network, DNS, and HTTP events occurring during OONI measurements.

This library contains replacements for commonly used standard library interfaces that facilitate seamless network measurements. By using such replacements, as opposed to standard library interfaces, we can:

  • save the timing of HTTP events (e.g. received response headers)
  • save the timing and result of every Connect, Read, Write, Close operation
  • save the timing and result of the TLS handshake (including certificates)

By default, this library uses the system resolver. In addition, it is possible to configure alternative DNS transports and remote servers. We support DNS over UDP, DNS over TCP, DNS over TLS (DoT), and DNS over HTTPS (DoH). When using an alternative transport, we are also able to intercept and save DNS messages, as well as any other interaction with the remote server (e.g., the result of the TLS handshake for DoT and DoH).

This package is a fork of github.com/ooni/netx.