Commit Graph

61 Commits

Author SHA1 Message Date
klzgrad
f9f98eedd9 Revert "Disable PartitionAlloc for old device builds"
This reverts commit 15fe90088c.
2022-11-12 15:13:17 +08:00
klzgrad
15fe90088c Disable PartitionAlloc for old device builds 2022-11-12 14:29:20 +08:00
klzgrad
44e5796908 Enable PartitionAlloc on OpenWrt 2022-11-11 01:33:43 +08:00
klzgrad
d1cef3d803 allocator: Fix __THROW and mallinfo for Musl 2022-11-11 01:33:43 +08:00
klzgrad
6e5b245e64 Add PartitionAlloc support
Fix a crash on Mac.

The crash is in partition_alloc::internal::PartitionFreelistEntry::CheckFreeListForThreadCache()
called from partition_alloc::ThreadCache::PurgeCurrentThread().

The direct cause of the crash is an uninitialized ThreadCache being
accessed. The root cause is that the required initialization
routines are accidentally removed by the linker and not called.

This could happen because our code path related to PartitionAlloc
is an uncommon one and differs from the standard procedures used
by the browser processes.

Therefore fix the crash by adopting much of the PartitionAlloc
initialization procedures used by the browser processes.

PA config differences from the full browser:

* No PCScan
* No Backup Ref Ptr checks
* No RawPtr checks

New behavior enabled by this change:

* Thread Cache: very small performance gain because allocations are few,
  but this code path is more mainstream thus more likely to be well tested.
2022-11-11 01:20:00 +08:00
Elly Fong-Jones
611b3bdcf9 base: include sys/types.h in symbolize.h
It is needed for ssize_t. In glibc specifically, ssize_t happens to get
transitively included by some other header - I'm not sure exactly what -
but POSIX says ssize_t is in sys/types.h and in other libcs the included
is needed for the type.

Bug: 1380656
Change-Id: Ibeef8c80f44595b6056fc1be8a104ab7428aa8bb
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/3997878
Reviewed-by: Daniel Cheng <dcheng@chromium.org>
Commit-Queue: Elly Fong-Jones <ellyjones@chromium.org>
Cr-Commit-Position: refs/heads/main@{#1066486}
2022-11-04 07:18:48 +08:00
klzgrad
1a16a881a5 sysroot: Fix arm64 build requiring glibc 2.29
https://bugs.chromium.org/p/chromium/issues/detail?id=1309965#c5
2022-11-04 07:18:48 +08:00
klzgrad
62f24fdbc8 third_party/protobuf: Reduce the required alignment of ArenaString from 8 to 4
https://github.com/protocolbuffers/protobuf/pull/10298
2022-11-04 07:18:48 +08:00
klzgrad
519dcfb4b6 third_party/protobuf: Disable musttail on MIPS
clang reports:

fatal error: error in backend: failed to perform tail call elimination on a call site marked musttail
2022-11-04 07:18:48 +08:00
klzgrad
a196a21709 net: Remove upstream temporary debug code breaking build 2022-11-04 07:18:48 +08:00
klzgrad
b352765b77 Add continuous integration and tests 2022-11-04 07:18:48 +08:00
klzgrad
c55997b837 Add build scripts 2022-11-04 07:18:48 +08:00
klzgrad
29405c119d Add example config.json 2022-11-04 07:18:47 +08:00
klzgrad
826e884bcc Add README 2022-11-04 07:18:47 +08:00
klzgrad
ea65ce0f64 Add LICENSE 2022-11-04 07:18:47 +08:00
klzgrad
7879e29223 Add source import tool 2022-11-04 07:18:47 +08:00
klzgrad
1f9e66c1ba Add initial implementation of Naive client 2022-11-04 07:18:47 +08:00
klzgrad
0e75c24879 build: Use thinlto max optimization for everything 2022-11-04 07:18:47 +08:00
klzgrad
35e3ad0111 base: Fix Android build missing -latomic 2022-11-04 07:18:47 +08:00
klzgrad
ded57b1ea6 base: Fix OpenWrt build with use_allocator_shim=false 2022-11-04 07:18:47 +08:00
klzgrad
7e851c81bb allocator: Improve MIPS coverage of spinlocks 2022-11-04 07:18:47 +08:00
klzgrad
7207b7044b debug: Fix uClibc macro condition 2022-11-04 07:18:47 +08:00
klzgrad
e4c689b677 third_party: Fix missing sgidefs.h for Musl 2022-11-04 07:18:47 +08:00
klzgrad
4b8ec1241d base: Do not forward declare stat64 for Musl 2022-11-04 07:18:47 +08:00
klzgrad
f3ed9d4a06 base: Fix narrowing casting for Musl 2022-11-04 07:18:47 +08:00
klzgrad
33cf85bea6 base: Disable __close overloading for Musl 2022-11-04 07:18:47 +08:00
klzgrad
cd949bb531 process: Remove use of mallinfo for Musl 2022-11-04 07:18:47 +08:00
klzgrad
5ece33830d base: Remove use of mallinfo for Musl 2022-11-04 07:18:47 +08:00
klzgrad
d7b841824c dns: Support Musl 2022-11-04 07:18:47 +08:00
klzgrad
4bc41bb0e5 dns: Fix iwyu 2022-11-04 07:18:47 +08:00
klzgrad
85967e5081 debug: Fix obsolete max check 2022-11-04 07:18:47 +08:00
klzgrad
2145769e56 build: Add sysroot creator script 2022-11-04 07:18:47 +08:00
klzgrad
db1de79807 build: Add OpenWrt toolchains 2022-11-04 07:18:47 +08:00
klzgrad
f24a03ee35 build: Support ARM build without FPU 2022-11-04 07:18:47 +08:00
klzgrad
8de9c5108b build: Support -mcpu= on ARM and ARM64 2022-11-04 07:18:47 +08:00
klzgrad
2a92f014c6 quic: Add support for HTTP/3 CONNECT Fast Open
SpdyProxyClientSocket uses read_callback_ for both Connect() and
Read(), and its OnIOComplete() calls read_callback_, thus its fast
connect code checks read_callback_. The code was ported to
QuicProxyClientSocket without much change.

But QuicProxyClientSocket uses a separate connect_callback_ apart from
read_callback_, and its OnIOComplete() calls connect_callback_, thus
when headers are received after Connect() it doesn't need to check
read_callback_ and should always avoid calling connect_callback_.
2022-11-04 07:18:47 +08:00
klzgrad
200eddf85e h2: Pad RST_STREAM frames
Clients sending too many RST_STREAM is an irregular behavior.

Hack in a preceding END_STREAM DATA frame padded towards [48, 72]
before RST_STREAM so that the TLS record looks like a HEADERS frame.

The server often replies to this with a WINDOW_UPDATE because padding
is accounted in flow control. Whether this constitudes a new irregular
behavior is still unclear.
2022-11-04 07:18:47 +08:00
klzgrad
dc49ae6d4a h2: Add support for HTTP/2 CONNECT Fast Open
SpdyProxyClientSocket waits for 200 OK before returning OK for Connect.

Change that behavior to returning OK immediately after CONNECT header.

This feature is enabled by a "fastopen" header via the proxy delegate.

Design notes:

The current approach is better than the obvious TCP Fast Open style fake
Connect().

Fast Open should not be used for preconnects as preconnects need actual
connections set up. The Naive client does not use preconnects per se
(using "...RawConnect") but the user agent will use preconnects and the
Naive client has to infer that. Hence there is a need to check the
incoming socket for available bytes right before Connect() and configure
whether a socket should be connected with Fast Open. But fake Connect()
make it difficult to check the incoming socket because it immediately
returns and there is not enough time for the first read of the incoming
socket to arrive.

To check for preconnects it is best to push the first read of the
incoming socket to as late as possible. The other (wrong) way of doing
that is to pass in an early read callback and call it immediately after
sending HEADERS and then send the available bytes right there. This way
is wrong because it does not work with late binding, which assumes
Connect() is idempotent and causes sockets opened in this way to be
potentially bound to the wrong socket requests.

The current approach is to return OK in Connect() right after sending
HEADERS before getting the reply, which is to be received later. If the
reply is received during a subsequent Read() and the reply indicates an
error, the error is returned to the callback of the Read(); otherwise
the error is ignored with the connection disconnected and subsequent
Read() and Write() should discover the disconnection.
2022-11-04 07:18:47 +08:00
klzgrad
de9f6c0518 h2: Reduce warnings about RST on invalid streams
Per RFC 7540#6.4:

  However, after sending the RST_STREAM, the sending endpoint MUST be
  prepared to receive and process additional frames sent on the stream
  that might have been sent by the peer prior to the arrival of the
  RST_STREAM.
2022-11-04 07:18:47 +08:00
klzgrad
9945961f15 socket: Force tunneling for all sockets
In the socket system, only WebSocket sockets are allowed to tunnel
through HTTP/1 proxies. "Raw" sockets in the normal socket pool don't
have it, and their CONNECT headers are not sent, instead the raw
payload is sent as-is to the HTTP/1 proxy, breaking the proxying.

The socket system works like this:

- HTTP sockets via HTTP/1 proxies: normal pool, no tunneling.
- HTTPS sockets via HTTP/1 proxies: normal pool, no tunneling,
  but does its own proxy encapsulation.
- WS sockets via HTTP/1 proxies: WS pool, tunneling.

In Naive, we need the normal pool because the WS pool has some extra
restrictions but we also need tunneling to produce a client socket
with proxy tunneling built in.

Therefore force tunneling for all sockets and have them always send
CONNECT headers. This will otherwise break regular HTTP client sockets
via HTTP/1 proxies, but as we don't use this combination, it is ok.
2022-11-04 07:18:47 +08:00
klzgrad
3e89280a4f socket: Allow higher limits for proxies
As an intermediary proxy we should not enforce stricter connection
limits in addition to what the user is already enforcing.
2022-11-04 07:18:47 +08:00
klzgrad
b4e9348c1c socket: Add RawConnect method 2022-11-04 07:18:47 +08:00
klzgrad
d567d69b53 cert: Handle AIA response in PKCS#7 format 2022-11-04 07:18:47 +08:00
klzgrad
fd6a39672d cert: Use builtin verifier on Android and Linux 2022-11-04 07:18:47 +08:00
klzgrad
24b45bd8b8 cert: Add SystemTrustStoreStaticUnix
It reads CA certificates from:

* The file in environment variable SSL_CERT_FILE
* The first available file of

/etc/ssl/certs/ca-certificates.crt (Debian/Ubuntu/Gentoo etc.)
/etc/pki/tls/certs/ca-bundle.crt (Fedora/RHEL 6)
/etc/ssl/ca-bundle.pem (OpenSUSE)
/etc/pki/tls/cacert.pem (OpenELEC)
/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem (CentOS/RHEL 7)
/etc/ssl/cert.pem (Alpine Linux)

* Files in the directory of environment variable SSL_CERT_DIR
* Files in the first available directory of

/etc/ssl/certs (SLES10/SLES11, https://golang.org/issue/12139)
/etc/pki/tls/certs (Fedora/RHEL)
/system/etc/security/cacerts (Android)
2022-11-04 07:18:47 +08:00
klzgrad
44de1d8dc8 libc++: Disable exceptions and RTTI
Except on Mac, where exceptions are required.
And except on Android, where rtti is required.
2022-11-04 07:18:47 +08:00
klzgrad
ab86fa908b url: Remove perfetto tracing 2022-11-04 07:18:47 +08:00
klzgrad
e56c989216 base: Disable trace event
This allows builds with enable_base_tracing=false.
2022-11-04 07:18:47 +08:00
klzgrad
c58f093441 lss: Avoid naming conflict in fstatat64
Supports OpenWrt builds.
2022-11-04 07:18:47 +08:00
klzgrad
c497d8d491 base: Fix iwyu in file_path.cc 2022-11-04 07:18:47 +08:00