Commit Graph

57 Commits

Author SHA1 Message Date
klzgrad
cf86a92792 Fix broken overloading of libc close in static OpenWrt build 2023-11-05 20:00:18 +08:00
klzgrad
d1fda19a12 boringssl: Fix import iwyu 2023-11-05 20:00:18 +08:00
klzgrad
dd9edafde5 dns: Fix iwyu on win 2023-11-05 20:00:18 +08:00
klzgrad
cfa0f08e28 brotli: Fix missing import in BUILD.gn
is_ubsan is not declared when imported from net/BUILD.gn
2023-11-05 20:00:18 +08:00
klzgrad
2ff3a20857 third_party/protobuf: Reduce the required alignment of ArenaString from 8 to 4
https://github.com/protocolbuffers/protobuf/pull/10298
2023-11-05 20:00:18 +08:00
klzgrad
38a1f21214 third_party/protobuf: Disable musttail on MIPS
clang reports:

fatal error: error in backend: failed to perform tail call elimination on a call site marked musttail
2023-11-05 20:00:18 +08:00
klzgrad
facf662c48 net: Remove upstream temporary debug code breaking build 2023-11-05 20:00:18 +08:00
klzgrad
71321ace5e Add continuous integration and tests 2023-11-05 20:00:18 +08:00
klzgrad
c1d9cd1340 build.sh 2023-11-05 19:27:33 +08:00
klzgrad
f80453e25f Add build scripts 2023-11-05 19:27:33 +08:00
klzgrad
46633d96fb Add example config.json 2023-11-05 19:27:33 +08:00
klzgrad
a3e7336296 Add README 2023-11-05 19:27:33 +08:00
klzgrad
50399faf6f Add LICENSE 2023-11-05 19:27:33 +08:00
klzgrad
e8fde66555 Add source import tool 2023-11-05 19:27:33 +08:00
klzgrad
4d832a42cb Add Naive 2023-11-05 19:27:33 +08:00
klzgrad
0dcddfb356 build: Use thinlto max optimization for everything 2023-11-05 19:27:33 +08:00
klzgrad
b41d0b3b12 base: Fix Android build adding extra -latomic
We don't use use_sysroot=true, but without it -latomic is added
to is_android.
2023-11-05 19:27:33 +08:00
klzgrad
51b5c70c6a base: Fix OpenWrt build with use_allocator_shim=false 2023-11-05 19:27:33 +08:00
klzgrad
4e1562642a allocator: Disable PartitionAlloc memory tagging on non-glibc
Memory tagging depends on ifunc which is glibc-specific.
2023-11-05 19:27:33 +08:00
klzgrad
b48109eed3 allocator: Fix PartitionAlloc mipsel build 2023-11-05 19:27:33 +08:00
klzgrad
bb7c0e1962 allocator: Fix recommitted pages not being zeroed when madvise is not available.
Support kernels built without CONFIG_ADVISE_SYSCALLS on small
embedded devices.
2023-11-05 19:27:33 +08:00
klzgrad
ded0a85522 allocator: Fix __THROW and mallinfo for Musl 2023-11-05 19:27:33 +08:00
klzgrad
2f8b6f82d5 allocator: Improve MIPS coverage of spinlocks 2023-11-05 19:27:33 +08:00
klzgrad
2d1d2354e4 debug: Fix uClibc macro condition 2023-11-05 19:27:33 +08:00
klzgrad
8a62cd66b2 third_party: Fix missing sgidefs.h for Musl 2023-11-05 19:27:33 +08:00
klzgrad
fd83ac7d75 process: Remove use of mallinfo for Musl 2023-11-05 19:27:33 +08:00
klzgrad
25ad784a60 base: Remove use of mallinfo for Musl 2023-11-05 19:27:33 +08:00
klzgrad
5590410b3c dns: Support Musl 2023-11-05 19:27:33 +08:00
klzgrad
9c9d625f59 lss: Avoid naming conflict in fstatat64
Supports OpenWrt builds.
2023-11-05 19:27:32 +08:00
klzgrad
c3b84af9c9 build: Add sysroot creator script 2023-11-05 19:27:32 +08:00
klzgrad
a7ba8c7b18 build: Add OpenWrt toolchains 2023-11-05 19:27:32 +08:00
klzgrad
f7251a2397 build: Support ARM build without FPU 2023-11-05 19:27:32 +08:00
klzgrad
3b0c78626d build: Support -mcpu= on ARM and ARM64 2023-11-05 19:27:32 +08:00
klzgrad
77c45fe30f quic: Add support for HTTP/3 CONNECT Fast Open
SpdyProxyClientSocket uses read_callback_ for both Connect() and
Read(), and its OnIOComplete() calls read_callback_, thus its fast
connect code checks read_callback_. The code was ported to
QuicProxyClientSocket without much change.

But QuicProxyClientSocket uses a separate connect_callback_ apart from
read_callback_, and its OnIOComplete() calls connect_callback_, thus
when headers are received after Connect() it doesn't need to check
read_callback_ and should always avoid calling connect_callback_.
2023-11-05 19:27:32 +08:00
klzgrad
6fef01f378 h2: Pad RST_STREAM frames
Clients sending too many RST_STREAM is an irregular behavior.

Hack in a preceding END_STREAM DATA frame padded towards [48, 72]
before RST_STREAM so that the TLS record looks like a HEADERS frame.

The server often replies to this with a WINDOW_UPDATE because padding
is accounted in flow control. Whether this constitudes a new irregular
behavior is still unclear.
2023-11-05 19:27:32 +08:00
klzgrad
9cebef2e84 h2: Add support for HTTP/2 CONNECT Fast Open
SpdyProxyClientSocket waits for 200 OK before returning OK for Connect.

Change that behavior to returning OK immediately after CONNECT header.

This feature is enabled by a "fastopen" header via the proxy delegate.

Design notes:

The current approach is better than the obvious TCP Fast Open style fake
Connect().

Fast Open should not be used for preconnects as preconnects need actual
connections set up. The Naive client does not use preconnects per se
(using "...RawConnect") but the user agent will use preconnects and the
Naive client has to infer that. Hence there is a need to check the
incoming socket for available bytes right before Connect() and configure
whether a socket should be connected with Fast Open. But fake Connect()
make it difficult to check the incoming socket because it immediately
returns and there is not enough time for the first read of the incoming
socket to arrive.

To check for preconnects it is best to push the first read of the
incoming socket to as late as possible. The other (wrong) way of doing
that is to pass in an early read callback and call it immediately after
sending HEADERS and then send the available bytes right there. This way
is wrong because it does not work with late binding, which assumes
Connect() is idempotent and causes sockets opened in this way to be
potentially bound to the wrong socket requests.

The current approach is to return OK in Connect() right after sending
HEADERS before getting the reply, which is to be received later. If the
reply is received during a subsequent Read() and the reply indicates an
error, the error is returned to the callback of the Read(); otherwise
the error is ignored with the connection disconnected and subsequent
Read() and Write() should discover the disconnection.
2023-11-05 19:27:32 +08:00
klzgrad
b3734b2d79 h2: Reduce warnings about RST on invalid streams
Per RFC 7540#6.4:

  However, after sending the RST_STREAM, the sending endpoint MUST be
  prepared to receive and process additional frames sent on the stream
  that might have been sent by the peer prior to the arrival of the
  RST_STREAM.
2023-11-05 19:27:32 +08:00
klzgrad
d105ea4b41 socket: Force tunneling for all sockets
In the socket system, only WebSocket sockets are allowed to tunnel
through HTTP/1 proxies. "Raw" sockets in the normal socket pool don't
have it, and their CONNECT headers are not sent, instead the raw
payload is sent as-is to the HTTP/1 proxy, breaking the proxying.

The socket system works like this:

- HTTP sockets via HTTP/1 proxies: normal pool, no tunneling.
- HTTPS sockets via HTTP/1 proxies: normal pool, no tunneling,
  but does its own proxy encapsulation.
- WS sockets via HTTP/1 proxies: WS pool, tunneling.

In Naive, we need the normal pool because the WS pool has some extra
restrictions but we also need tunneling to produce a client socket
with proxy tunneling built in.

Therefore force tunneling for all sockets and have them always send
CONNECT headers. This will otherwise break regular HTTP client sockets
via HTTP/1 proxies, but as we don't use this combination, it is ok.
2023-11-05 19:27:32 +08:00
klzgrad
ad673c2540 socket: Allow higher limits for proxies
As an intermediary proxy we should not enforce stricter connection
limits in addition to what the user is already enforcing.
2023-11-05 19:27:32 +08:00
klzgrad
698990779a socket: Add RawConnect method 2023-11-05 19:27:32 +08:00
klzgrad
6c99b16304 cert: Handle AIA response in PKCS#7 format 2023-11-05 19:27:32 +08:00
klzgrad
cbdc164eba cert: Use builtin verifier on Android and Linux 2023-11-05 19:27:32 +08:00
klzgrad
414c760fe7 cert: Add SystemTrustStoreStaticUnix
It reads CA certificates from:

* The file in environment variable SSL_CERT_FILE
* The first available file of

/etc/ssl/certs/ca-certificates.crt (Debian/Ubuntu/Gentoo etc.)
/etc/pki/tls/certs/ca-bundle.crt (Fedora/RHEL 6)
/etc/ssl/ca-bundle.pem (OpenSUSE)
/etc/pki/tls/cacert.pem (OpenELEC)
/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem (CentOS/RHEL 7)
/etc/ssl/cert.pem (Alpine Linux)

* Files in the directory of environment variable SSL_CERT_DIR
* Files in the first available directory of

/etc/ssl/certs (SLES10/SLES11, https://golang.org/issue/12139)
/etc/pki/tls/certs (Fedora/RHEL)
/system/etc/security/cacerts (Android)
2023-11-05 19:27:32 +08:00
klzgrad
77f0aa4d99 libc++: Disable exceptions and RTTI
Except on Mac, where exceptions are required.
And except on Android, where rtti is required.
2023-11-05 19:27:32 +08:00
klzgrad
477a938bef base: Disable trace event
This allows builds with enable_base_tracing=false.
2023-11-05 19:27:32 +08:00
klzgrad
cb7540969c base: Fix iwyu in file_path.cc 2023-11-05 19:27:32 +08:00
klzgrad
b1df412254 base: Don't fix Y2038 problem with icu 2023-11-05 19:27:32 +08:00
klzgrad
9e94216530 net, url: Remove icu 2023-11-05 19:27:32 +08:00
klzgrad
5cee07bb7d build: Force determinism in official build
Helps build with ccache.
2023-11-05 19:27:32 +08:00
klzgrad
0f42590b7a build: Disable Android java templates 2023-11-05 19:27:32 +08:00