Go to file
Simone Basso 0fdc9cafb5
fix(all): introduce and use iox.ReadAllContext (#379)
* fix(all): introduce and use iox.ReadAllContext

This improvement over the ioutil.ReadAll utility returns early
if the context expires. This enables us to unblock stuck code in
case there's censorship confounding the TCP stack.

See https://github.com/ooni/probe/issues/1417.

Compared to the functionality postulated in the above mentioned
issue, I choose to be more generic and separate limiting the
maximum body size (not implemented here) from using the context
to return early when reading a body (or any other reader).

After implementing iox.ReadAllContext, I made sure we always
use it everywhere in the tree instead of ioutil.ReadAll.

This includes many parts of the codebase where in theory we don't
need iox.ReadAllContext. Though, changing all the places makes
checking whether we're not using ioutil.ReadAll where we should
not be using it easy: `git grep` should return no lines.

* Update internal/iox/iox_test.go

* fix(ndt7): treat context errors as non-errors

The rationale is explained by the comment documenting reduceErr.

* Update internal/engine/experiment/ndt7/download.go
2021-06-15 11:57:40 +02:00
.github/workflows feat: make sure our debian repo is WAI (#351) 2021-05-19 14:12:33 +02:00
.vscode feat(make): sign more generated binaries (#330) 2021-05-05 14:26:19 +02:00
CLI fix(debian): make sure we can publish all archs (#350) 2021-05-19 13:54:19 +02:00
cmd fix(all): introduce and use iox.ReadAllContext (#379) 2021-06-15 11:57:40 +02:00
debian feat(gha): build debian package using ./make (#331) 2021-05-06 22:13:09 +02:00
docs doc: ensure all top dirs have an explanatory README (#214) 2021-02-03 16:54:00 +01:00
E2E feat: make sure our debian repo is WAI (#351) 2021-05-19 14:12:33 +02:00
internal fix(all): introduce and use iox.ReadAllContext (#379) 2021-06-15 11:57:40 +02:00
MOBILE refactor(make): better checks for tool existence and paths (#327) 2021-05-05 11:33:51 +02:00
pkg refactor: flatten and separate (#353) 2021-06-04 10:34:18 +02:00
QA refactor: redesign how we import assets (#260) 2021-04-01 16:57:31 +02:00
testdata feat: introduce ptx package for pluggable transports dialers (#373) 2021-06-14 10:20:54 +02:00
.gitignore fix(debian): make sure we can publish all archs (#350) 2021-05-19 13:54:19 +02:00
CODE_OF_CONDUCT.md doc: add code of conduct (#157) 2020-11-03 21:16:04 +01:00
CODEOWNERS chore: continue merging probe-engine into probe-cli (#211) 2021-02-03 14:42:51 +01:00
CONTRIBUTING.md fix(all): introduce and use iox.ReadAllContext (#379) 2021-06-15 11:57:40 +02:00
go.mod quic: use RFC9000 version (#376) 2021-06-14 16:59:24 +02:00
go.sum quic: use RFC9000 version (#376) 2021-06-14 16:59:24 +02:00
LICENSE.md Add LICENSE.md 2018-07-11 18:06:27 +02:00
mk fix(debian): make sure we can publish all archs (#350) 2021-05-19 13:54:19 +02:00
Readme.md refactor: replace ./make (python3) with ./mk (makefile) (#343) 2021-05-11 16:15:13 +02:00
testjafar.bash refactor: enable QA tests and jafar self test (#208) 2021-02-03 13:20:37 +01:00

OONI Probe Client Library and CLI

GoDoc Short Tests Status All Tests Status Coverage Status Go Report Card linux-debian-packages GitHub issues by-label

The next generation OONI Probe: client library and Command Line Interface.

User setup

Please, follow the instructions at ooni.org/install/cli to install ooniprobe. If we do not support your use case, please let us know.

Once ooniprobe is installed, try ooniprobe help to get interactive help.

Reporting issues

Please, report issues with this codebase at github.com/ooni/probe. Please, make sure you tag such issues using the ooni/probe-cli label.

Repository organization

Every top-level directory contains an explanatory README file.

OONIProbe

Be sure you have golang >= 1.16 and a C compiler (when developing for Windows, you need Mingw-w64 installed). You can build using:

go build -v ./cmd/ooniprobe

This will generate a binary called ooniprobe in the current directory.

Android bindings

Make sure you have GNU make installed, then run:

./mk android

Builds bindings for Android. (Add OONI_PSIPHON_TAGS="" if you cannot clone private repositories in the https://github.com/ooni namespace.)

The generated bindings are (manually) pushed to the Maven Central package repository. The instructions explaining how to integrate these bindings are published along with the release notes.

iOS bindings

Make sure you have GNU make installed, then run:

./mk ios

Builds bindings for iOS. (Add OONI_PSIPHON_TAGS="" if you cannot clone private repositories in the https://github.com/ooni namespace.)

The generated bindings are (manually) added to GitHub releases. The instructions explaining how to integrate these bindings are published along with the release notes.

miniooni

Miniooni is the experimental OONI client used for research. Compile using:

go build -v ./internal/cmd/miniooni

This will generate a binary called miniooni in the current directory.

Updating dependencies

go get -u -v ./... && go mod tidy

Releasing

Create an issue according to the routine release template and perform any item inside the check-list.

We build releases using ./mk, which requires GNU make. Try the ./mk help|less command for detailed usage.