Commit Graph

53 Commits

Author SHA1 Message Date
klzgrad
ce80501ac2 Add cert net fetcher 2022-02-09 07:44:48 +08:00
klzgrad
f40e8024da Redirect DNS for redir://
Run a fake stub DNS resolver at the same port with redir://.
2022-02-09 07:44:48 +08:00
klzgrad
ef636dfb5b Support TCP transparent proxying
Enable with naive --listen=redir:// and iptables ... -j REDIRECT
--to-ports 1080.
2022-02-09 07:44:48 +08:00
klzgrad
76fd62c5c7 Support loading config.json 2022-02-09 07:44:48 +08:00
klzgrad
70745161b5 Add QUIC client 2022-02-09 07:44:48 +08:00
klzgrad
6dabd09444 Add http_proxy_socket to BUILD.gn 2022-02-09 07:44:48 +08:00
klzgrad
be237b5636 Add server implementation and tunnel padding 2022-02-09 07:44:48 +08:00
klzgrad
77bb1f692e Add Naive client to BUILD.gn 2022-02-09 07:44:48 +08:00
klzgrad
f694f40836 Add initial implementation of Naive client 2022-02-09 07:44:48 +08:00
klzgrad
d5764d0313 allocator: Improve MIPS coverage of spinlocks 2022-02-09 07:44:48 +08:00
klzgrad
74302c2cfe debug: Fix uClibc macro condition 2022-02-09 07:44:48 +08:00
klzgrad
d98c27032e third_party: Fix missing sgidefs.h for Musl 2022-02-09 07:44:48 +08:00
klzgrad
773db2b6e3 base: Do not forward declare stat64 for Musl 2022-02-09 07:44:48 +08:00
klzgrad
15c431ff5e base: Fix narrowing casting for Musl 2022-02-09 07:44:48 +08:00
klzgrad
0cb647b4c2 base: Disable __close overloading for Musl 2022-02-09 07:44:48 +08:00
klzgrad
d3154fd407 process: Remove use of mallinfo for Musl 2022-02-09 07:44:48 +08:00
klzgrad
5cb7f630c2 base: Remove use of mallinfo for Musl 2022-02-09 07:44:47 +08:00
klzgrad
3f95e1399c udp: Fix mmsghdr struct initializer for Musl
On OpenWrt x64 there are paddings fields in the struct, making
the initializer list not work.
2022-02-09 07:44:47 +08:00
klzgrad
54af5860db dns: Support Musl 2022-02-09 07:44:47 +08:00
klzgrad
f3b87ecf9d dns: Fix iwyu 2022-02-09 07:44:47 +08:00
klzgrad
504d1adf1f debug: Fix obsolete max check 2022-02-09 07:44:47 +08:00
klzgrad
b4f8033b22 build: Handle empty pkgconfig in sysroot 2022-02-09 07:44:47 +08:00
klzgrad
b559fee946 build: Add sysroot creator script 2022-02-09 07:44:47 +08:00
klzgrad
7572f16a09 build: Add OpenWrt toolchains 2022-02-09 07:44:47 +08:00
klzgrad
6bff8d566c build: Support MIPS -mtune= flag 2022-02-09 07:44:47 +08:00
klzgrad
ccaef084f3 build: Support ARM build without FPU 2022-02-09 07:44:47 +08:00
klzgrad
fd1e25c266 build: Support -mcpu= on ARM and ARM64 2022-02-09 07:44:47 +08:00
klzgrad
88ae25ac86 quic: Add support for HTTP/3 CONNECT Fast Open
SpdyProxyClientSocket uses read_callback_ for both Connect() and
Read(), and its OnIOComplete() calls read_callback_, thus its fast
connect code checks read_callback_. The code was ported to
QuicProxyClientSocket without much change.

But QuicProxyClientSocket uses a separate connect_callback_ apart from
read_callback_, and its OnIOComplete() calls connect_callback_, thus
when headers are received after Connect() it doesn't need to check
read_callback_ and should always avoid calling connect_callback_.
2022-02-09 07:44:47 +08:00
klzgrad
3cbe69b02d h2: Pad RST_STREAM frames
Clients sending too many RST_STREAM is an irregular behavior.

Hack in a preceding END_STREAM DATA frame padded towards [48, 72]
before RST_STREAM so that the TLS record looks like a HEADERS frame.

The server often replies to this with a WINDOW_UPDATE because padding
is accounted in flow control. Whether this constitudes a new irregular
behavior is still unclear.
2022-02-09 07:44:47 +08:00
klzgrad
848fd69a67 h2: Add support for HTTP/2 CONNECT Fast Open
SpdyProxyClientSocket waits for 200 OK before returning OK for Connect.

Change that behavior to returning OK immediately after CONNECT header.

This feature is enabled by a "fastopen" header via the proxy delegate.

Design notes:

The current approach is better than the obvious TCP Fast Open style fake
Connect().

Fast Open should not be used for preconnects as preconnects need actual
connections set up. The Naive client does not use preconnects per se
(using "...RawConnect") but the user agent will use preconnects and the
Naive client has to infer that. Hence there is a need to check the
incoming socket for available bytes right before Connect() and configure
whether a socket should be connected with Fast Open. But fake Connect()
make it difficult to check the incoming socket because it immediately
returns and there is not enough time for the first read of the incoming
socket to arrive.

To check for preconnects it is best to push the first read of the
incoming socket to as late as possible. The other (wrong) way of doing
that is to pass in an early read callback and call it immediately after
sending HEADERS and then send the available bytes right there. This way
is wrong because it does not work with late binding, which assumes
Connect() is idempotent and causes sockets opened in this way to be
potentially bound to the wrong socket requests.

The current approach is to return OK in Connect() right after sending
HEADERS before getting the reply, which is to be received later. If the
reply is received during a subsequent Read() and the reply indicates an
error, the error is returned to the callback of the Read(); otherwise
the error is ignored with the connection disconnected and subsequent
Read() and Write() should discover the disconnection.
2022-02-09 07:44:47 +08:00
klzgrad
0c0d8772bc h2: Reduce warnings about RST on invalid streams
Per RFC 7540#6.4:

  However, after sending the RST_STREAM, the sending endpoint MUST be
  prepared to receive and process additional frames sent on the stream
  that might have been sent by the peer prior to the arrival of the
  RST_STREAM.
2022-02-09 07:44:47 +08:00
klzgrad
b777252ebd socket: Force tunneling for all sockets
In the socket system, only WebSocket sockets are allowed to tunnel
through HTTP/1 proxies. "Raw" sockets in the normal socket pool don't
have it, and their CONNECT headers are not sent, instead the raw
payload is sent as-is to the HTTP/1 proxy, breaking the proxying.

The socket system works like this:

- HTTP sockets via HTTP/1 proxies: normal pool, no tunneling.
- HTTPS sockets via HTTP/1 proxies: normal pool, no tunneling,
  but does its own proxy encapsulation.
- WS sockets via HTTP/1 proxies: WS pool, tunneling.

In Naive, we need the normal pool because the WS pool has some extra
restrictions but we also need tunneling to produce a client socket
with proxy tunneling built in.

Therefore force tunneling for all sockets and have them always send
CONNECT headers. This will otherwise break regular HTTP client sockets
via HTTP/1 proxies, but as we don't use this combination, it is ok.
2022-02-09 07:44:47 +08:00
klzgrad
fc1bf8edea socket: Allow higher limits for proxies
As an intermediary proxy we should not enforce stricter connection
limits in addition to what the user is already enforcing.
2022-02-09 07:44:47 +08:00
klzgrad
8455a278f4 socket: Add RawConnect method 2022-02-09 07:44:47 +08:00
klzgrad
f1e5d3dd45 build: Disable NSS
NSS is used to manage root trust store. This part is reimplemented.
2022-02-09 07:44:47 +08:00
klzgrad
a57b048aff cert: Handle AIA response in PKCS#7 format 2022-02-09 07:44:47 +08:00
klzgrad
47f8255830 cert: Use builtin verifier on Android and Linux 2022-02-09 07:44:47 +08:00
klzgrad
5b387bba2e cert: Add SystemTrustStoreStaticUnix
It reads CA certificates from:

* The file in environment variable SSL_CERT_FILE
* The first available file of

/etc/ssl/certs/ca-certificates.crt (Debian/Ubuntu/Gentoo etc.)
/etc/pki/tls/certs/ca-bundle.crt (Fedora/RHEL 6)
/etc/ssl/ca-bundle.pem (OpenSUSE)
/etc/pki/tls/cacert.pem (OpenELEC)
/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem (CentOS/RHEL 7)
/etc/ssl/cert.pem (Alpine Linux)

* Files in the directory of environment variable SSL_CERT_DIR
* Files in the first available directory of

/etc/ssl/certs (SLES10/SLES11, https://golang.org/issue/12139)
/etc/pki/tls/certs (Fedora/RHEL)
/system/etc/security/cacerts (Android)
2022-02-09 07:44:47 +08:00
klzgrad
fa1329c700 libc++: Guard C++20 atomic type aliases
https://reviews.llvm.org/D75183
https://github.com/ziglang/zig/issues/6573
2022-02-09 07:44:47 +08:00
klzgrad
0b60c6a9c1 libc++: Disable exceptions and RTTI
Except on Mac, where disabling exceptions doesn't work.
2022-02-09 07:44:47 +08:00
klzgrad
94a4454a01 url: Remove perfetto tracing 2022-02-09 07:44:47 +08:00
klzgrad
3de16a5484 base: Disable trace event
This allows builds with enable_base_tracing=false.
2022-02-09 07:44:47 +08:00
klzgrad
58ece71cf6 lss: Avoid naming conflict in fstatat64
Supports OpenWrt builds.
2022-02-09 07:44:47 +08:00
klzgrad
8a4e72f73a base: Don't fix Y2038 problem with icu 2022-02-09 07:44:47 +08:00
klzgrad
b08ce31076 net, url: Remove icu 2022-02-09 07:44:47 +08:00
klzgrad
1596dc6087 build: Force determinism in official build
Helps build with ccache.
2022-02-09 07:44:47 +08:00
klzgrad
d2c3285fcc build: Disable Android java templates 2022-02-09 07:44:47 +08:00
klzgrad
9cdd5f0ab6 build: Disable build_with_chromium
The argument build_with_chromium mainly enables various tests,
data bundling, infra integration, and AFDO profiles.

AFDO can be added by other arguments.
2022-02-09 07:44:47 +08:00
klzgrad
0d81a856ad base: Add Android stubs 2022-02-09 07:44:47 +08:00
klzgrad
c8d4f72308 net: Add Android stubs 2022-02-09 07:44:47 +08:00