Date: Fri, 19 Jul 2024 21:08:25 +0200 From: David Sterba To: torvalds@linux-foundation.org Cc: David Sterba , linux-btrfs@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [GIT PULL] Btrfs build fix for 6.11 Hi, please pull a fix for build breakage on 32bit platforms. I misjudged the severity of the fix, it first looked like a functional fix that could wait but failing subset of builds should not (-Werror=overflow). I'm not aware of any reports from linux-next build coverage before merge window. Thanks. ---------------------------------------------------------------- The following changes since commit 8e7860543a94784d744c7ce34b78a2e11beefa5c: btrfs: fix extent map use-after-free when adding pages to compressed bio (2024-07-11 16:32:22 +0200) are available in the Git repository at: git://git.kernel.org/pub/scm/linux/kernel/git/kdave/linux.git tags/for-6.11-tag for you to fetch changes up to c3ece6b7ffb4a7c00e8d53cbf4026a32b6127914: btrfs: change BTRFS_MOUNT_* flags to 64bit type (2024-07-19 17:20:23 +0200) ---------------------------------------------------------------- Qu Wenruo (1): btrfs: change BTRFS_MOUNT_* flags to 64bit type fs/btrfs/fs.h | 66 ++++++++++++++++++++++++++++---------------------------- fs/btrfs/super.c | 11 +++++----- fs/btrfs/super.h | 3 ++- fs/btrfs/zoned.c | 3 ++- fs/btrfs/zoned.h | 5 +++-- 5 files changed, 46 insertions(+), 42 deletions(-) . Date: Mon, 1 Aug 2022 18:40:03 +0200 From: David Sterba To: torvalds@linux-foundation.org Cc: linux-btrfs@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [GIT PULL] Btrfs updates for 5.20 Hi, this update brings some long awaited changes, the send protocol bump, otherwise lots of small improvements and fixes. The main core part is reworking bio handling, cleaning up the submission and endio and improving error handling. There are some non-btrfs patches adding helpers or updating API, listed at the end of the changelog. Please pull, thanks. Features: - sysfs: - export chunk size, in debug mode add tunable for setting its size - show zoned among features (was only in debug mode) - show commit stats (number, last/max/total duration) - send protocol updated to 2 - new commands: - ability write larger data chunks than 64K - send raw compressed extents (uses the encoded data ioctls), ie. no decompression on send side, no compression needed on receive side if supported - send 'otime' (inode creation time) among other timestamps - send file attributes (a.k.a file flags and xflags) - this is first version bump, backward compatibility on send and receive side is provided - there are still some known and wanted commands that will be implemented in the near future, another version bump will be needed, however we want to minimize that to avoid causing usability issues - print checksum type and implementation at mount time - don't print some messages at mount (mentioned as people asked about it), we want to print messages namely for new features so let's make some space for that - big metadata - this has been supported for a long time and is not a feature that's worth mentioning - skinny metadata - same reason, set by default by mkfs Performance improvements: - reduced amount of reserved metadata for delayed items - when inserted items can be batched into one leaf - when deleting batched directory index items - when deleting delayed items used for deletion - overall improved count of files/sec, decreased subvolume lock contention - metadata item access bounds checker micro-optimized, with a few percent of improved runtime for metadata-heavy operations - increase direct io limit for read to 256 sectors, improved throughput by 3x on sample workload Notable fixes: - raid56 - reduce parity writes, skip sectors of stripe when there are no data updates - restore reading from stripe cache instead of triggering new read - refuse to replay log with unknown incompat read-only feature bit set - zoned - fix page locking when COW fails in the middle of allocation - improved tracking of active zones, ZNS drives may limit the number and there are ENOSPC errors due to that limit and not actual lack of space - adjust maximum extent size for zone append so it does not cause late ENOSPC due to underreservation - mirror reading error messages show the mirror number - don't fallback to buffered IO for NOWAIT direct IO writes, we don't have the NOWAIT semantics for buffered io yet - send, fix sending link commands for existing file paths when there are deleted and created hardlinks for same files - repair all mirrors for profiles with more than 1 copy (raid1c34) - fix repair of compressed extents, unify where error detection and repair happen Core changes: - bio completion cleanups - don't double defer compression bios - simplify endio workqueues - add more data to btrfs_bio to avoid allocation for read requests - rework bio error handling so it's same what block layer does, the submission works and errors are consumed in endio - when asynchronous bio offload fails fall back to synchronous checksum calculation to avoid errors under writeback or memory pressure - new trace points - raid56 events - ordered extent operations - super block log_root_transid deprecated (never used) - mixed_backref and big_metadata sysfs feature files removed, they've been default for sufficiently long time, there are no known users and mixed_backref could be confused with mixed_groups Non-btrfs changes, API updates: - minor highmem API update to cover const arguments - switch all kmap/kmap_atomic to kmap_local - remove redundant flush_dcache_page() - address_space_operations::writepage callback removed - add bdev_max_segments() helper ---------------------------------------------------------------- The following changes since commit e0dccc3b76fb35bb257b4118367a883073d7390e: Linux 5.19-rc8 (2022-07-24 13:26:27 -0700) are available in the Git repository at: git://git.kernel.org/pub/scm/linux/kernel/git/kdave/linux.git for-5.20-tag for you to fetch changes up to 0b078d9db8793b1bd911e97be854e3c964235c78: btrfs: don't call btrfs_page_set_checked in finish_compressed_bio_read (2022-07-25 19:56:16 +0200) ---------------------------------------------------------------- BingJing Chang (2): btrfs: send: introduce recorded_ref_alloc and recorded_ref_free btrfs: send: fix sending link commands for existing file paths Christoph Hellwig (37): btrfs: factor out a helper to end a single sector buffer I/O btrfs: refactor end_bio_extent_readpage code flow btrfs: factor out a btrfs_csum_ptr helper btrfs: use btrfs_bio_for_each_sector in btrfs_check_read_dio_bio btrfs: move more work into btrfs_end_bioc btrfs: simplify code flow in btrfs_submit_dio_bio btrfs: split btrfs_submit_data_bio to read and write parts btrfs: defer I/O completion based on the btrfs_raid_bio btrfs: don't double-defer bio completions for compressed reads btrfs: don't use btrfs_bio_wq_end_io for compressed writes btrfs: centralize setting REQ_META btrfs: remove btrfs_end_io_wq btrfs: factor stripe submission logic out of btrfs_map_bio btrfs: do not allocate a btrfs_bio for low-level bios btrfs: don't use bio->bi_private to pass the inode to submit_one_bio btrfs: merge end_write_bio and flush_write_bio btrfs: pass the btrfs_bio_ctrl to submit_one_bio btrfs: stop looking at btrfs_bio->iter in index_one_bio btrfs: split discard handling out of btrfs_map_block btrfs: remove the finish_func argument to btrfs_mark_ordered_io_finished btrfs: increase direct io read size limit to 256 sectors btrfs: remove extent writepage address space operation btrfs: raid56: use fixed stripe length everywhere btrfs: do not return errors from btrfs_map_bio btrfs: do not return errors from raid56_parity_write btrfs: do not return errors from raid56_parity_recover btrfs: raid56: transfer the bio counter reference to the raid submission helpers btrfs: simplify sync/async submission in btrfs_submit_data_write_bio btrfs: handle allocation failure in btrfs_wq_submit_bio gracefully btrfs: do not return errors from btrfs_submit_dio_bio btrfs: merge btrfs_dev_stat_print_on_error with its only caller btrfs: repair all known bad mirrors btrfs: simplify the pending I/O counting in struct compressed_bio btrfs: pass a btrfs_bio to btrfs_repair_one_sector btrfs: remove the start argument to check_data_csum and export btrfs: fix repair of compressed extents btrfs: don't call btrfs_page_set_checked in finish_compressed_bio_read David Sterba (30): btrfs: fix typos in comments btrfs: remove redundant calls to flush_dcache_page btrfs: remove redundant check in up check_setget_bounds btrfs: sysfs: advertise zoned support among features btrfs: open code rbtree search in split_state btrfs: open code rbtree search in insert_state btrfs: lift start and end parameters to callers of insert_state btrfs: pass bits by value not by pointer for extent_state helpers btrfs: add fast path for extent_state insertion btrfs: remove node and parent parameters from insert_state btrfs: open code inexact rbtree search in tree_search btrfs: make tree search for insert more generic and use it for tree_search btrfs: unify tree search helper returning prev and next nodes btrfs: call inode_to_path directly and drop indirection btrfs: simplify parameters of backref iterators btrfs: sink iterator parameter to btrfs_ioctl_logical_to_ino btrfs: remove unused typedefs get_extent_t and btrfs_work_func_t btrfs: send: drop __KERNEL__ ifdef from send.h btrfs: send: simplify includes btrfs: send: remove old TODO regarding ERESTARTSYS btrfs: send: use boolean types for current inode status btrfs: send: add OTIME as utimes attribute for proto 2+ by default btrfs: send: add new command FILEATTR for file attributes btrfs: print checksum type and implementation at mount time btrfs: use mask for all RAID1* profiles in btrfs_calc_avail_data_space btrfs: merge calculations for simple striped profiles in btrfs_rmap_block btrfs: clean up chained assignments btrfs: switch btrfs_block_rsv::full to bool btrfs: switch btrfs_block_rsv::failfast to bool btrfs: use enum for btrfs_block_rsv::type Fabio M. De Francesco (7): btrfs: replace kmap() with kmap_local_page() in inode.c btrfs: replace kmap() with kmap_local_page() in lzo.c highmem: Make __kunmap_{local,atomic}() take const void pointer btrfs: zstd: replace kmap() with kmap_local_page() btrfs: zlib: replace kmap() with kmap_local_page() in zlib_compress_pages() btrfs: zlib: replace kmap() with kmap_local_page() in zlib_decompress_bio() btrfs: replace kmap_atomic() with kmap_local_page() Fanjun Kong (1): btrfs: use PAGE_ALIGNED instead of IS_ALIGNED Filipe Manana (18): btrfs: balance btree dirty pages and delayed items after a rename btrfs: free the path earlier when creating a new inode btrfs: balance btree dirty pages and delayed items after clone and dedupe btrfs: add assertions when deleting batches of delayed items btrfs: deal with deletion errors when deleting delayed items btrfs: refactor the delayed item deletion entry point btrfs: improve batch deletion of delayed dir index items btrfs: assert that delayed item is a dir index item when adding it btrfs: improve batch insertion of delayed dir index items btrfs: do not BUG_ON() on failure to reserve metadata for delayed item btrfs: set delayed item type when initializing it btrfs: reduce amount of reserved metadata for delayed item insertion btrfs: remove the inode cache check at btrfs_is_free_space_inode() btrfs: don't fallback to buffered IO for NOWAIT direct IO writes btrfs: set the objectid of the btree inode's location key btrfs: add optimized btrfs_ino() version for 64 bits systems btrfs: send: always use the rbtree based inode ref management infrastructure btrfs: join running log transaction when logging new name Ioannis Angelakopoulos (2): btrfs: collect commit stats, count, duration btrfs: sysfs: export commit stats Johannes Thumshirn (1): btrfs: add tracepoints for ordered extents Josef Bacik (3): btrfs: do not batch insert non-consecutive dir indexes during log replay btrfs: tree-log: make the return value for log syncing consistent btrfs: reset block group chunk force if we have to wait Naohiro Aota (17): btrfs: ensure pages are unlocked on cow_file_range() failure btrfs: extend btrfs_cleanup_ordered_extents for NULL locked_page btrfs: fix error handling of fallback uncompress write btrfs: replace unnecessary goto with direct return at cow_file_range() block: add bdev_max_segments() helper btrfs: zoned: revive max_zone_append_bytes btrfs: replace BTRFS_MAX_EXTENT_SIZE with fs_info->max_extent_size btrfs: convert count_max_extents() to use fs_info->max_extent_size btrfs: use fs_info->max_extent_size in get_extent_max_capacity() btrfs: let can_allocate_chunk return error btrfs: zoned: finish least available block group on data bg allocation btrfs: zoned: introduce space_info->active_total_bytes btrfs: zoned: disable metadata overcommit for zoned btrfs: zoned: activate metadata block group on flush_space btrfs: zoned: activate necessary block group btrfs: zoned: write out partially allocated region btrfs: zoned: wait until zone is finished when allocation didn't progress Nikolay Borisov (9): btrfs: introduce btrfs_try_lock_balance btrfs: use btrfs_try_lock_balance in btrfs_ioctl_balance btrfs: batch up release of reserved metadata for delayed items used for deletion btrfs: properly flag filesystem with BTRFS_FEATURE_INCOMPAT_BIG_METADATA btrfs: don't print 'flagging with big metadata' anymore on mount btrfs: don't print 'has skinny extents' anymore on mount btrfs: sysfs: remove MIXED_BACKREF feature file btrfs: sysfs: remove BIG_METADATA feature files btrfs: simplify error handling in btrfs_lookup_dentry Omar Sandoval (7): btrfs: send: remove unused send_ctx::{total,cmd}_send_size btrfs: send: explicitly number commands and attributes btrfs: send: add stream v2 definitions btrfs: send: write larger chunks when using stream v2 btrfs: send: get send buffer pages for protocol v2 btrfs: send: send compressed extents with encoded writes btrfs: send: enable support for stream v2 and compressed writes Pankaj Raghav (1): btrfs: zoned: fix comment description for sb_write_pointer logic Qu Wenruo (25): btrfs: quit early if the fs has no RAID56 support for raid56 related checks btrfs: introduce a data checksum checking helper btrfs: remove duplicated parameters from submit_data_read_repair() btrfs: add a helper to iterate through a btrfs_bio with sector sized chunks btrfs: use integrated bitmaps for btrfs_raid_bio::dbitmap and finish_pbitmap btrfs: use integrated bitmaps for scrub_parity::dbitmap and ebitmap btrfs: only write the sectors in the vertical stripe which has data stripes btrfs: update stripe_sectors::uptodate in steal_rbio btrfs: add trace event for submitted RAID56 bio btrfs: make btrfs_super_block::log_root_transid deprecated btrfs: reject log replay if there is unsupported RO compat flag btrfs: raid56: avoid double for loop inside finish_rmw() btrfs: raid56: avoid double for loop inside __raid56_parity_recover() btrfs: raid56: avoid double for loop inside alloc_rbio_essential_pages() btrfs: raid56: avoid double for loop inside raid56_rmw_stripe() btrfs: raid56: avoid double for loop inside raid56_parity_scrub_stripe() btrfs: remove parameter dev_extent_len from scrub_stripe() btrfs: use btrfs_chunk_max_errors() to replace tolerance calculation btrfs: use btrfs_raid_array to calculate number of parity stripes btrfs: use ncopies from btrfs_raid_array in btrfs_num_copies() btrfs: use named constant for reserved device space btrfs: warn about dev extents that are inside the reserved range btrfs: raid56: don't trust any cached sector in __raid56_parity_recover() btrfs: output mirror number for bad metadata btrfs: return proper mapped length for RAID56 profiles in __btrfs_map_block() Stefan Roesch (3): btrfs: store chunk size in space-info struct btrfs: sysfs: export chunk size in space infos btrfs: sysfs: add force_chunk_alloc trigger to force allocation arch/parisc/include/asm/cacheflush.h | 6 +- arch/parisc/kernel/cache.c | 2 +- fs/btrfs/async-thread.h | 1 - fs/btrfs/backref.c | 88 ++-- fs/btrfs/backref.h | 3 +- fs/btrfs/block-group.c | 34 +- fs/btrfs/block-rsv.c | 21 +- fs/btrfs/block-rsv.h | 15 +- fs/btrfs/btrfs_inode.h | 25 +- fs/btrfs/compression.c | 359 ++++---------- fs/btrfs/compression.h | 18 +- fs/btrfs/ctree.h | 105 ++++- fs/btrfs/delalloc-space.c | 6 +- fs/btrfs/delayed-inode.c | 395 +++++++++++----- fs/btrfs/delayed-inode.h | 11 + fs/btrfs/delayed-ref.c | 4 +- fs/btrfs/dev-replace.c | 3 +- fs/btrfs/disk-io.c | 268 ++++------- fs/btrfs/disk-io.h | 17 +- fs/btrfs/extent-tree.c | 149 +++--- fs/btrfs/extent_io.c | 873 ++++++++++++++++------------------- fs/btrfs/extent_io.h | 15 +- fs/btrfs/file.c | 29 +- fs/btrfs/free-space-cache.c | 3 +- fs/btrfs/inode.c | 764 +++++++++++++++--------------- fs/btrfs/ioctl.c | 150 +++--- fs/btrfs/lzo.c | 28 +- fs/btrfs/ordered-data.c | 40 +- fs/btrfs/ordered-data.h | 5 +- fs/btrfs/raid56.c | 792 +++++++++++++++---------------- fs/btrfs/raid56.h | 168 ++++++- fs/btrfs/reflink.c | 19 +- fs/btrfs/scrub.c | 71 ++- fs/btrfs/send.c | 781 +++++++++++++++++++++---------- fs/btrfs/send.h | 169 ++++--- fs/btrfs/space-info.c | 110 ++++- fs/btrfs/space-info.h | 8 +- fs/btrfs/struct-funcs.c | 11 +- fs/btrfs/subpage.c | 4 +- fs/btrfs/super.c | 36 +- fs/btrfs/sysfs.c | 186 +++++++- fs/btrfs/tests/btrfs-tests.c | 1 + fs/btrfs/tests/extent-buffer-tests.c | 3 +- fs/btrfs/transaction.c | 26 +- fs/btrfs/tree-log.c | 29 +- fs/btrfs/tree-log.h | 3 + fs/btrfs/volumes.c | 362 +++++++-------- fs/btrfs/volumes.h | 46 +- fs/btrfs/zlib.c | 42 +- fs/btrfs/zoned.c | 131 +++++- fs/btrfs/zoned.h | 18 + fs/btrfs/zstd.c | 33 +- include/linux/blkdev.h | 5 + include/linux/highmem-internal.h | 10 +- include/trace/events/btrfs.h | 158 +++++++ include/uapi/linux/btrfs.h | 10 +- mm/highmem.c | 2 +- 57 files changed, 3842 insertions(+), 2829 deletions(-) . Date: Fri, 19 Aug 2022 14:00:51 +0200 From: David Sterba To: torvalds@linux-foundation.org Cc: linux-btrfs@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [GIT PULL] Btrfs fixes for 6.0-rc2 Hi, a few short fixes and a lockdep warning fix (needs moving some code). Please pull, thanks. - tree-log replay fixes - fix error handling when looking up extent refs - fix warning when setting inode number of links - relocation fixes - reset block group read-only status when relocation fails - unset control structure if transaction fails when starting to process a block group - add lockdep annotations to fix a warning during relocation where blocks temporarily belong to another tree and can lead to reversed dependencies - tree-checker verifies if extent items don't overlap ---------------------------------------------------------------- The following changes since commit 0b078d9db8793b1bd911e97be854e3c964235c78: btrfs: don't call btrfs_page_set_checked in finish_compressed_bio_read (2022-07-25 19:56:16 +0200) are available in the Git repository at: git://git.kernel.org/pub/scm/linux/kernel/git/kdave/linux.git for-6.0-rc1-tag for you to fetch changes up to 899b7f69f244e539ea5df1b4d756046337de44a5: btrfs: tree-checker: check for overlapping extent items (2022-08-17 16:20:25 +0200) ---------------------------------------------------------------- Filipe Manana (2): btrfs: fix lost error handling when looking up extended ref on log replay btrfs: fix warning during log replay when bumping inode link count Josef Bacik (4): btrfs: reset RO counter on block group if we fail to relocate btrfs: move lockdep class helpers to locking.c btrfs: fix lockdep splat with reloc root extent buffers btrfs: tree-checker: check for overlapping extent items Zixuan Fu (1): btrfs: unset reloc control if transaction commit fails in prepare_to_relocate() fs/btrfs/block-group.c | 4 ++- fs/btrfs/ctree.c | 3 ++ fs/btrfs/ctree.h | 2 ++ fs/btrfs/disk-io.c | 82 -------------------------------------------- fs/btrfs/disk-io.h | 10 ------ fs/btrfs/extent-tree.c | 18 +++++++++- fs/btrfs/extent_io.c | 11 +++++- fs/btrfs/locking.c | 91 +++++++++++++++++++++++++++++++++++++++++++++++++ fs/btrfs/locking.h | 14 ++++++++ fs/btrfs/relocation.c | 9 ++++- fs/btrfs/tree-checker.c | 25 ++++++++++++-- fs/btrfs/tree-log.c | 8 +++-- 12 files changed, 176 insertions(+), 101 deletions(-) . Date: Sun, 28 Aug 2022 14:57:29 +0200 From: David Sterba To: torvalds@linux-foundation.org Cc: linux-btrfs@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [GIT PULL] Btrfs fixes for v6.0-rc3 Hi, a few more fixes and regressions. Please pull, thanks. - fixes: - check that subvolume is writable when changing xattrs from security namespace - fix memory leak in device lookup helper - update generation of hole file extent item when merging holes - fix space cache corruption and potential double allocations; this is a rare bug but can be serious once it happens, stable backports and analysis tool will be provided - fix error handling when deleting root references - fix crash due to assert when attempting to cancel suspended device replace, add message what to do if mount fails due to missing replace item - regressions: - don't merge pages into bio if their page offset is not contiguous - don't allow large NOWAIT direct reads, this could lead to short reads eg. in io_uring ---------------------------------------------------------------- The following changes since commit 899b7f69f244e539ea5df1b4d756046337de44a5: btrfs: tree-checker: check for overlapping extent items (2022-08-17 16:20:25 +0200) are available in the Git repository at: git://git.kernel.org/pub/scm/linux/kernel/git/kdave/linux.git for-6.0-rc3-tag for you to fetch changes up to f2c3bec215694fb8bc0ef5010f2a758d1906fc2d: btrfs: add info when mount fails due to stale replace target (2022-08-23 22:15:21 +0200) ---------------------------------------------------------------- Anand Jain (2): btrfs: replace: drop assert for suspended replace btrfs: add info when mount fails due to stale replace target Filipe Manana (2): btrfs: update generation of hole file extent item when merging holes btrfs: fix silent failure when deleting root reference Goldwyn Rodrigues (1): btrfs: check if root is readonly while setting security xattr Josef Bacik (1): btrfs: don't allow large NOWAIT direct reads Omar Sandoval (1): btrfs: fix space cache corruption and potential double allocations Qu Wenruo (1): btrfs: don't merge pages into bio if their page offset is not contiguous Zixuan Fu (1): btrfs: fix possible memory leak in btrfs_get_dev_args_from_path() fs/btrfs/block-group.c | 47 +++++++++++++++-------------------------------- fs/btrfs/block-group.h | 4 +--- fs/btrfs/ctree.h | 1 - fs/btrfs/dev-replace.c | 5 ++--- fs/btrfs/extent-tree.c | 30 ++++++------------------------ fs/btrfs/extent_io.c | 33 +++++++++++++++++++++++++++++---- fs/btrfs/file.c | 2 ++ fs/btrfs/inode.c | 14 ++++++++++++++ fs/btrfs/root-tree.c | 5 +++-- fs/btrfs/volumes.c | 5 ++++- fs/btrfs/xattr.c | 3 +++ 11 files changed, 79 insertions(+), 70 deletions(-) . Date: Fri, 9 Sep 2022 11:06:31 +0200 From: David Sterba To: torvalds@linux-foundation.org Cc: David Sterba , linux-btrfs@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [GIT PULL] Btrfs fixes for 6.0-rc5 Hi, a few more fixes to zoned mode and one regression fix for chunk limit. Please pull, thanks. - zoned fixes: - fix how wait/wake up is done when finishing zone - fix zone append limit in emulated mode - fix mount on devices with conventional zones - fix regression, user settable data chunk limit got accidentally lowered and causes allocation problems on some profiles (raid0, raid1) ---------------------------------------------------------------- The following changes since commit f2c3bec215694fb8bc0ef5010f2a758d1906fc2d: btrfs: add info when mount fails due to stale replace target (2022-08-23 22:15:21 +0200) are available in the Git repository at: git://git.kernel.org/pub/scm/linux/kernel/git/kdave/linux.git for-6.0-rc4-tag for you to fetch changes up to 5da431b71d4b9be3c8cf6786eff9e2d41a5f9f65: btrfs: fix the max chunk size and stripe length calculation (2022-09-06 17:49:58 +0200) ---------------------------------------------------------------- Johannes Thumshirn (1): btrfs: zoned: fix mounting with conventional zones Naohiro Aota (1): btrfs: zoned: fix API misuse of zone finish waiting Qu Wenruo (1): btrfs: fix the max chunk size and stripe length calculation Shin'ichiro Kawasaki (1): btrfs: zoned: set pseudo max append zone limit in zone emulation mode fs/btrfs/ctree.h | 2 -- fs/btrfs/disk-io.c | 1 - fs/btrfs/inode.c | 7 ++-- fs/btrfs/space-info.c | 2 +- fs/btrfs/volumes.c | 3 ++ fs/btrfs/zoned.c | 99 +++++++++++++++++++++++++++------------------------ 6 files changed, 60 insertions(+), 54 deletions(-) . Date: Tue, 20 Sep 2022 15:05:42 +0200 From: David Sterba To: torvalds@linux-foundation.org Cc: David Sterba , linux-btrfs@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [GIT PULL] Btrfs fixes for 6.0-rc7 Hi, a few more fixes, also for stable backports. Please pull, thanks. - two fixes for hangs in the umount sequence where threads depend on each other and the work must be finished in the right order - in zoned mode, wait for flushing all block group metadata IO before finishing the zone ---------------------------------------------------------------- The following changes since commit 5da431b71d4b9be3c8cf6786eff9e2d41a5f9f65: btrfs: fix the max chunk size and stripe length calculation (2022-09-06 17:49:58 +0200) are available in the Git repository at: git://git.kernel.org/pub/scm/linux/kernel/git/kdave/linux.git for-6.0-rc6-tag for you to fetch changes up to 2dd7e7bc02829eded71be2342a93dc035f5223f9: btrfs: zoned: wait for extent buffer IOs before finishing a zone (2022-09-13 14:05:18 +0200) ---------------------------------------------------------------- Filipe Manana (2): btrfs: fix hang during unmount when stopping block group reclaim worker btrfs: fix hang during unmount when stopping a space reclaim worker Naohiro Aota (1): btrfs: zoned: wait for extent buffer IOs before finishing a zone fs/btrfs/disk-io.c | 42 ++++++++++++++++++++++++++++++++++++------ fs/btrfs/zoned.c | 40 ++++++++++++++++++++++++++++++++++++++-- 2 files changed, 74 insertions(+), 8 deletions(-) . Date: Tue, 4 Oct 2022 08:31:21 +0200 From: David Sterba To: torvalds@linux-foundation.org Cc: David Sterba , linux-btrfs@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [GIT PULL] Btrfs updates for 6.1 Hi, please pull the following updates for btrfs. There's a bunch of performance improvements, most notably the FIEMAP speedup, the new block group tree to speed up mount on large filesystems, more io_uring integration, some sysfs exports and the usual fixes and core updates. Thanks. --- Performance: - outstanding FIEMAP speed improvement - algorithmic change how extents are enumerated leads to orders of magnitude speed boost (uncached and cached) - extent sharing check speedup (2.2x uncached, 3x cached) - add more cancellation points, allowing to interrupt seeking in files with large number of extents - more efficient hole and data seeking (4x uncached, 1.3x cached) - sample results: 256M, 32K extents: 4s -> 29ms (~150x) 512M, 64K extents: 30s -> 59ms (~550x) 1G, 128K extents: 225s -> 120ms (~1800x) - improved inode logging, especially for directories (on dbench workload throughput +25%, max latency -21%) - improved buffered IO, remove redundant extent state tracking, lowering memory consumption and avoiding rb tree traversal - add sysfs tunable to let qgroup temporarily skip exact accounting when deleting snapshot, leading to a speedup but requiring a rescan after that, will be used by snapper - support io_uring and buffered writes, until now it was just for direct IO, with the no-wait semantics implemented in the buffered write path it now works and leads to speed improvement in IOPS (2x), throughput (2.2x), latency (depends, 2x to 150x) - small performance improvements when dropping and searching for extent maps as well as when flushing delalloc in COW mode (throughput +5MB/s) User visible changes: - new incompatible feature block-group-tree adding a dedicated tree for tracking block groups, this allows a much faster load during mount and avoids seeking unlike when it's scattered in the extent tree items - this reduces mount time for many-terabyte sized filesystems - conversion tool will be provided so existing filesystem can also be updated in place - to reduce test matrix and feature combinations requires no-holes and free-space-tree (mkfs defaults since 5.15) - improved reporting of super block corruption detected by scrub - scrub also tries to repair super block and does not wait until next commit - discard stats and tunables are exported in sysfs (/sys/fs/btrfs/FSID/discard) - qgroup status is exported in sysfs (/sys/sys/fs/btrfs/FSID/qgroups/) - verify that super block was not modified when thawing filesystem Fixes: - FIEMAP fixes - fix extent sharing status, does not depend on the cached status where merged - flush delalloc so compressed extents are reported correctly - fix alignment of VMA for memory mapped files on THP - send: fix failures when processing inodes with no links (orphan files and directories) - fix race between quota enable and quota rescan ioctl - handle more corner cases for read-only compat feature verification - fix missed extent on fsync after dropping extent maps Core: - lockdep annotations to validate various transactions states and state transitions - preliminary support for fs-verity in send - more effective memory use in scrub for subpage where sector is smaller than page - block group caching progress logic has been removed, load is now synchronous - simplify end IO callbacks and bio handling, use chained bios instead of own tracking - add no-wait semantics to several functions (tree search, nocow, flushing, buffered write - cleanups and refactoring MM changes: - export balance_dirty_pages_ratelimited_flags ---------------------------------------------------------------- The following changes since commit f76349cf41451c5c42a99f18a9163377e4b364ff: Linux 6.0-rc7 (2022-09-25 14:01:02 -0700) are available in the Git repository at: git://git.kernel.org/pub/scm/linux/kernel/git/kdave/linux.git for-6.1-tag for you to fetch changes up to cbddcc4fa3443fe8cfb2ff8e210deb1f6a0eea38: btrfs: set generation before calling btrfs_clean_tree_block in btrfs_init_new_buffer (2022-09-29 17:08:31 +0200) ---------------------------------------------------------------- Alexander Zhu (1): btrfs: fix alignment of VMA for memory mapped files on THP BingJing Chang (2): btrfs: send: refactor arguments of get_inode_info() btrfs: send: fix failures when processing inodes with no links Boris Burkov (1): btrfs: send: add support for fs-verity Christoph Hellwig (13): btrfs: don't create integrity bioset for btrfs_bioset btrfs: move btrfs_bio allocation to volumes.c btrfs: pass the operation to btrfs_bio_alloc btrfs: don't take a bio_counter reference for cloned bios btrfs: use chained bios when cloning btrfs: properly abstract the parity raid bio handling btrfs: give struct btrfs_bio a real end_io handler btrfs: factor out low-level bio setup from submit_stripe_bio btrfs: decide bio cloning inside submit_stripe_bio btrfs: add fast path for single device io in __btrfs_map_block btrfs: stop allocation a btrfs_io_context for simple I/O btrfs: zoned: refactor device checks in btrfs_check_zoned_mode btrfs: stop tracking failed reads in the I/O tree Christophe JAILLET (1): btrfs: qgroup: fix a typo in a comment David Sterba (3): btrfs: sysfs: use sysfs_streq for string matching btrfs: sysfs: show discard stats and tunables in non-debug build btrfs: add KCSAN annotations for unlocked access to block_rsv->full Ethan Lien (1): btrfs: remove unnecessary EXTENT_UPTODATE state in buffered I/O path Filipe Manana (42): btrfs: don't drop dir index range items when logging a directory btrfs: remove the root argument from log_new_dir_dentries() btrfs: update stale comment for log_new_dir_dentries() btrfs: free list element sooner at log_new_dir_dentries() btrfs: avoid memory allocation at log_new_dir_dentries() for common case btrfs: remove root argument from btrfs_delayed_item_reserve_metadata() btrfs: store index number instead of key in struct btrfs_delayed_item btrfs: remove unused logic when looking up delayed items btrfs: shrink the size of struct btrfs_delayed_item btrfs: search for last logged dir index if it's not cached in the inode btrfs: move need_log_inode() to above log_conflicting_inodes() btrfs: move log_new_dir_dentries() above btrfs_log_inode() btrfs: log conflicting inodes without holding log mutex of the initial inode btrfs: skip logging parent dir when conflicting inode is not a dir btrfs: use delayed items when logging a directory btrfs: simplify adding and replacing references during log replay btrfs: simplify error handling at btrfs_del_root_ref() btrfs: fix race between quota enable and quota rescan ioctl btrfs: allow hole and data seeking to be interruptible btrfs: make hole and data seeking a lot more efficient btrfs: remove check for impossible block start for an extent map at fiemap btrfs: remove zero length check when entering fiemap btrfs: properly flush delalloc when entering fiemap btrfs: allow fiemap to be interruptible btrfs: rename btrfs_check_shared() to a more descriptive name btrfs: speedup checking for extent sharedness during fiemap btrfs: skip unnecessary extent buffer sharedness checks during fiemap btrfs: make fiemap more efficient and accurate reporting extent sharedness btrfs: remove useless used space increment during space reservation btrfs: fix missed extent on fsync after dropping extent maps btrfs: move btrfs_drop_extent_cache() to extent_map.c btrfs: use extent_map_end() at btrfs_drop_extent_map_range() btrfs: use cond_resched_rwlock_write() during inode eviction btrfs: move open coded extent map tree deletion out of inode eviction btrfs: add helper to replace extent map range with a new extent map btrfs: remove the refcount warning/check at free_extent_map() btrfs: remove unnecessary extent map initializations btrfs: assert tree is locked when clearing extent map from logging btrfs: remove unnecessary NULL pointer checks when searching extent maps btrfs: remove unnecessary next extent map search btrfs: avoid pointless extent map tree search when flushing delalloc btrfs: drop extent map range more efficiently Gaosheng Cui (1): btrfs: remove btrfs_bit_radix_cachep declaration Ioannis Angelakopoulos (7): btrfs: add macros for annotating wait events with lockdep btrfs: add lockdep annotations for num_writers wait event btrfs: add lockdep annotations for num_extwriters wait event btrfs: add lockdep annotations for transaction states wait events btrfs: add lockdep annotations for pending_ordered wait event btrfs: change the lockdep class of free space inode's invalidate_lock btrfs: add lockdep annotations for the ordered extents wait event Jeff Layton (1): btrfs: remove stale prototype of btrfs_write_inode Josef Bacik (65): btrfs: use btrfs_fs_closing for background bg work btrfs: simplify arguments of btrfs_update_space_info and rename btrfs: handle space_info setting of bg in btrfs_add_bg_to_space_info btrfs: convert block group bit field to use bit helpers btrfs: remove lock protection for BLOCK_GROUP_FLAG_TO_COPY btrfs: simplify block group traversal in btrfs_put_block_group_cache btrfs: remove BLOCK_GROUP_FLAG_HAS_CACHING_CTL btrfs: remove lock protection for BLOCK_GROUP_FLAG_RELOCATING_REPAIR btrfs: delete btrfs_wait_space_cache_v1_finished btrfs: call __btrfs_remove_free_space_cache_locked on cache load failure btrfs: remove use btrfs_remove_free_space_cache instead of variant btrfs: rename clean_io_failure and remove extraneous args btrfs: unexport internal failrec functions btrfs: convert the io_failure_tree to a plain rb_tree btrfs: use find_first_extent_bit in btrfs_clean_io_failure btrfs: separate out the extent state and extent buffer init code btrfs: separate out the eb and extent state leak helpers btrfs: temporarily export alloc_extent_state helpers btrfs: move extent state init and alloc functions to their own file btrfs: convert BUG_ON(EXTENT_BIT_LOCKED) checks to ASSERT's btrfs: move simple extent bit helpers out of extent_io.c btrfs: export wait_extent_bit btrfs: move btrfs_debug_check_extent_io_range into extent-io-tree.c btrfs: temporarily export and move core extent_io_tree tree functions btrfs: temporarily export and then move extent state helpers btrfs: move a few exported extent_io_tree helpers to extent-io-tree.c btrfs: move core extent_io_tree functions to extent-io-tree.c btrfs: unexport btrfs_debug_check_extent_io_range btrfs: unexport all the temporary exports for extent-io-tree.c btrfs: remove struct tree_entry in extent-io-tree.c btrfs: use next_state instead of rb_next where we can btrfs: make tree_search return struct extent_state btrfs: make tree_search_for_insert return extent_state btrfs: make tree_search_prev_next return extent_state's btrfs: use next_state/prev_state in merge_state btrfs: move extent io tree unrelated prototypes to their appropriate header btrfs: drop exclusive_bits from set_extent_bit btrfs: remove the wake argument from clear_extent_bits btrfs: remove failed_start argument from set_extent_bit btrfs: drop extent_changeset from set_extent_bit btrfs: unify the lock/unlock extent variants btrfs: remove extent_io_tree::track_uptodate btrfs: get rid of extent_io_tree::dirty_bytes btrfs: don't clear CTL bits when trying to release extent state btrfs: replace delete argument with EXTENT_CLEAR_ALL_BITS btrfs: don't init io tree with private data for non-inodes btrfs: remove is_data_inode() checks in extent-io-tree.c btrfs: move btrfs_caching_type to block-group.h btrfs: move btrfs_full_stripe_locks_tree into block-group.h btrfs: move btrfs_init_async_reclaim_work prototype to space-info.h btrfs: move btrfs_pinned_by_swapfile prototype into volumes.h btrfs: move btrfs_swapfile_pin into volumes.h btrfs: move fs_info forward declarations to the top of ctree.h btrfs: move btrfs_csum_ptr to inode.c btrfs: move the fs_info related helpers closer to fs_info in ctree.h btrfs: move btrfs_ordered_sum_size into file-item.c btrfs: open code and remove btrfs_inode_sectorsize helper btrfs: open code and remove btrfs_insert_inode_hash helper btrfs: use a runtime flag to indicate an inode is a free space inode btrfs: add struct declarations in dev-replace.h btrfs: implement a nowait option for tree searches btrfs: make can_nocow_extent nowait compatible btrfs: add the ability to use NO_FLUSH for data reservations btrfs: add btrfs_try_lock_ordered_range btrfs: make btrfs_check_nocow_lock nowait compatible Maciej S. Szmigiero (1): btrfs: don't print information about space cache or tree every remount Omar Sandoval (2): btrfs: rename btrfs_insert_file_extent() to btrfs_insert_hole_extent() btrfs: get rid of block group caching progress logic Qu Wenruo (26): btrfs: dump extra info if one free space cache has more bitmaps than it should btrfs: scrub: properly report super block errors in system log btrfs: scrub: try to fix super block errors btrfs: scrub: remove impossible sanity checks btrfs: scrub: use pointer array to replace sblocks_for_recheck btrfs: scrub: factor out initialization of scrub_block into helper btrfs: scrub: factor out allocation and initialization of scrub_sector into helper btrfs: scrub: introduce scrub_block::pages for more efficient memory usage for subpage btrfs: scrub: remove scrub_sector::page and use scrub_block::pages instead btrfs: scrub: move logical/physical/dev/mirror_num from scrub_sector to scrub_block btrfs: scrub: use larger block size for data extent scrub btrfs: check superblock to ensure the fs was not modified at thaw time btrfs: output human readable space info flag btrfs: dump all space infos if we abort transaction due to ENOSPC btrfs: enhance unsupported compat RO flags handling btrfs: don't save block group root into super block btrfs: separate BLOCK_GROUP_TREE compat RO flag from EXTENT_TREE_V2 btrfs: sysfs: introduce global qgroup attribute group btrfs: introduce BTRFS_QGROUP_STATUS_FLAGS_MASK for later expansion btrfs: introduce BTRFS_QGROUP_RUNTIME_FLAG_CANCEL_RESCAN btrfs: introduce BTRFS_QGROUP_RUNTIME_FLAG_NO_ACCOUNTING to skip qgroup accounting btrfs: skip subtree scan if it's too high to avoid low stall in btrfs_commit_transaction() btrfs: update the comment for submit_extent_page() btrfs: switch page and disk_bytenr argument position for submit_extent_page() btrfs: move end_io_func argument to btrfs_bio_ctrl structure btrfs: relax block-group-tree feature dependency checks Stefan Roesch (7): mm: export balance_dirty_pages_ratelimited_flags() btrfs: make prepare_pages nowait compatible btrfs: make lock_and_cleanup_extent_if_need nowait compatible btrfs: plumb NOWAIT through the write path btrfs: make btrfs_buffered_write nowait compatible btrfs: assert nowait mode is not used for some btree search functions btrfs: enable nowait async buffered writes Tetsuo Handa (1): btrfs: set generation before calling btrfs_clean_tree_block in btrfs_init_new_buffer Uros Bizjak (1): btrfs: use atomic_try_cmpxchg in free_extent_buffer zhang songyi (1): btrfs: remove the unnecessary result variables fs/btrfs/Makefile | 2 +- fs/btrfs/backref.c | 155 +- fs/btrfs/backref.h | 20 +- fs/btrfs/block-group.c | 182 +-- fs/btrfs/block-group.h | 39 +- fs/btrfs/block-rsv.c | 3 +- fs/btrfs/block-rsv.h | 9 + fs/btrfs/btrfs_inode.h | 25 +- fs/btrfs/compression.c | 54 +- fs/btrfs/ctree.c | 43 +- fs/btrfs/ctree.h | 370 ++--- fs/btrfs/delalloc-space.c | 13 +- fs/btrfs/delalloc-space.h | 3 +- fs/btrfs/delayed-inode.c | 292 ++-- fs/btrfs/delayed-inode.h | 34 +- fs/btrfs/dev-replace.c | 16 +- fs/btrfs/dev-replace.h | 4 + fs/btrfs/disk-io.c | 303 ++-- fs/btrfs/disk-io.h | 7 +- fs/btrfs/extent-io-tree.c | 1673 +++++++++++++++++++++ fs/btrfs/extent-io-tree.h | 126 +- fs/btrfs/extent-tree.c | 33 +- fs/btrfs/extent_io.c | 2923 +++++++++---------------------------- fs/btrfs/extent_io.h | 17 +- fs/btrfs/extent_map.c | 347 ++++- fs/btrfs/extent_map.h | 8 + fs/btrfs/file-item.c | 38 +- fs/btrfs/file.c | 805 ++++++---- fs/btrfs/free-space-cache.c | 115 +- fs/btrfs/free-space-cache.h | 1 - fs/btrfs/free-space-tree.c | 8 - fs/btrfs/inode.c | 516 +++---- fs/btrfs/ioctl.c | 24 +- fs/btrfs/locking.c | 25 + fs/btrfs/locking.h | 1 + fs/btrfs/misc.h | 35 + fs/btrfs/ordered-data.c | 50 +- fs/btrfs/ordered-data.h | 13 +- fs/btrfs/props.c | 5 +- fs/btrfs/qgroup.c | 96 +- fs/btrfs/qgroup.h | 3 + fs/btrfs/raid56.c | 45 +- fs/btrfs/raid56.h | 4 +- fs/btrfs/reflink.c | 10 +- fs/btrfs/relocation.c | 40 +- fs/btrfs/root-tree.c | 16 +- fs/btrfs/scrub.c | 668 +++++---- fs/btrfs/send.c | 461 +++--- fs/btrfs/send.h | 15 +- fs/btrfs/space-info.c | 96 +- fs/btrfs/space-info.h | 9 +- fs/btrfs/super.c | 112 +- fs/btrfs/sysfs.c | 172 ++- fs/btrfs/tests/btrfs-tests.c | 2 +- fs/btrfs/tests/extent-io-tests.c | 7 +- fs/btrfs/tests/free-space-tests.c | 22 +- fs/btrfs/tests/inode-tests.c | 10 +- fs/btrfs/transaction.c | 162 +- fs/btrfs/tree-log.c | 1593 ++++++++++++-------- fs/btrfs/tree-log.h | 8 + fs/btrfs/verity.c | 3 +- fs/btrfs/volumes.c | 353 +++-- fs/btrfs/volumes.h | 50 +- fs/btrfs/zoned.c | 142 +- fs/verity/fsverity_private.h | 2 - include/linux/fsverity.h | 3 + include/trace/events/btrfs.h | 2 - include/uapi/linux/btrfs.h | 6 + include/uapi/linux/btrfs_tree.h | 4 + mm/page-writeback.c | 1 + 70 files changed, 7212 insertions(+), 5242 deletions(-) create mode 100644 fs/btrfs/extent-io-tree.c . Date: Tue, 18 Oct 2022 13:43:44 +0200 From: David Sterba To: torvalds@linux-foundation.org Cc: David Sterba , linux-btrfs@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [GIT PULL] Btrfs fixes for 6.1-rc2 Hi, please pull the following fixes, thanks. - fiemap fixes: - add missing path cache update - fix processing of delayed data and tree refs during backref walking, this could lead to reporting incorrect extent sharing - fix extent range locking under heavy contention to avoid deadlocks - make it possible to test send v3 in debugging mode - update links in MAINTAINERS ---------------------------------------------------------------- The following changes since commit cbddcc4fa3443fe8cfb2ff8e210deb1f6a0eea38: btrfs: set generation before calling btrfs_clean_tree_block in btrfs_init_new_buffer (2022-09-29 17:08:31 +0200) are available in the Git repository at: git://git.kernel.org/pub/scm/linux/kernel/git/kdave/linux.git for-6.1-rc1-tag for you to fetch changes up to 4efb365a3f04d0bee7833f168b0b00a15edefeac: MAINTAINERS: update btrfs website links and files (2022-10-14 13:54:21 +0200) ---------------------------------------------------------------- Boris Burkov (1): btrfs: send: allow protocol version 3 with CONFIG_BTRFS_DEBUG David Sterba (3): btrfs: send: update command for protocol version check btrfs: delete stale comments after merge conflict resolution MAINTAINERS: update btrfs website links and files Filipe Manana (4): btrfs: add missing path cache update during fiemap btrfs: fix processing of delayed data refs during backref walking btrfs: fix processing of delayed tree block refs during backref walking btrfs: ignore fiemap path cache if we have multiple leaves for a data extent Josef Bacik (1): btrfs: unlock locked extent area if we have contention MAINTAINERS | 6 ++-- fs/btrfs/backref.c | 84 ++++++++++++++++++++++++++++++++++++++--------- fs/btrfs/backref.h | 1 + fs/btrfs/block-group.c | 2 -- fs/btrfs/extent-io-tree.c | 15 +++++---- fs/btrfs/send.c | 5 ++- fs/btrfs/send.h | 5 +++ 7 files changed, 91 insertions(+), 27 deletions(-) . Date: Sun, 17 Sep 2023 22:16:08 +0800 From: Anand Jain To: zlang@kernel.org Cc: fstests@vger.kernel.org, Linux BTRFS Development , anand.jain@oracle.com Subject: [GIT PULL] fstests: btrfs changes for for-next v2023.09.03 These four patches are ready to be included in your for-next branch. I've consolidated them here for your git pull. Thanks, Anand ------------------------------------------------------------ The following changes since commit 2848174358e542de0ad18c42cd79f7208ae93711: xfs/559: adapt to kernels that use large folios for writes (2023-09-02 13:54:38 +0800) are available in the Git repository at: https://github.com/asj/fstests.git for-next for you to fetch changes up to 964d3327d3954ed589bf4a2f8c86302bbb37acf9: fstests: btrfs/185 update for single device pseudo device-scan (2023-09-17 21:20:53 +0800) ---------------------------------------------------------------- Anand Jain (4): fstests: btrfs/261 fix failure if /var/lib/btrfs isn't writable fstests: btrfs add more tests into the scrub group fstests: use btrfs check repair for repairing btrfs filesystems fstests: btrfs/185 update for single device pseudo device-scan common/rc | 16 ++++++++++++++++ tests/btrfs/011 | 2 +- tests/btrfs/027 | 2 +- tests/btrfs/060 | 2 +- tests/btrfs/062 | 2 +- tests/btrfs/063 | 2 +- tests/btrfs/064 | 2 +- tests/btrfs/065 | 2 +- tests/btrfs/067 | 2 +- tests/btrfs/068 | 2 +- tests/btrfs/070 | 2 +- tests/btrfs/071 | 2 +- tests/btrfs/074 | 2 +- tests/btrfs/148 | 2 +- tests/btrfs/185 | 5 +++-- tests/btrfs/195 | 2 +- tests/btrfs/261 | 6 ++++-- 17 files changed, 37 insertions(+), 18 deletions(-) . Date: Thu, 5 Oct 2023 18:54:46 +0800 From: Anand Jain To: zlang@kernel.org Cc: fstests@vger.kernel.org, linux-btrfs@vger.kernel.org Subject: [GIT PULL] fstests: btrfs changes for for-next v2023.10.05 Zorro, These patches have undergone testing and are now prepared for merging, based on your for-next branch. The following changes since commit 2fddeb5c79ff16bf37e1f1d809bd94b360c27801: btrfs/287: filter snapshot IDs to avoid failures when using some features (2023-09-23 22:13:11 +0800) are available in the Git repository at: https://github.com/asj/fstests.git staged-20231005 for you to fetch changes up to 9750f8d42560a459c89071c6a0bd68bdb467fa49: btrfs/295: skip on zoned device as we cannot corrupt it directly (2023-10-05 17:37:39 +0800) ---------------------------------------------------------------- Anand Jain (1): btrfs test scan but not register the single device fs Boris Burkov (6): common: refactor sysfs_attr functions btrfs: quota mode helpers btrfs/301: new test for simple quotas btrfs: quota rescan helpers btrfs: use new rescan wrapper btrfs: skip squota incompatible tests Filipe Manana (2): fstests: redirect fsstress' stdout to $seqres.full instead of /dev/null btrfs/192: use append operator to output log replay results to $seqres.full Naohiro Aota (3): btrfs/283: skip if we cannot write into one extent btrfs/076: fix file_size variable btrfs/295: skip on zoned device as we cannot corrupt it directly common/btrfs | 64 ++++++++++++++++ common/rc | 127 ++++++++++++++++++++----------- tests/btrfs/017 | 1 + tests/btrfs/022 | 1 + tests/btrfs/028 | 4 +- tests/btrfs/049 | 2 +- tests/btrfs/057 | 1 + tests/btrfs/060 | 2 +- tests/btrfs/061 | 2 +- tests/btrfs/062 | 2 +- tests/btrfs/063 | 2 +- tests/btrfs/064 | 2 +- tests/btrfs/065 | 2 +- tests/btrfs/066 | 2 +- tests/btrfs/067 | 2 +- tests/btrfs/068 | 2 +- tests/btrfs/069 | 2 +- tests/btrfs/070 | 2 +- tests/btrfs/071 | 2 +- tests/btrfs/072 | 2 +- tests/btrfs/073 | 2 +- tests/btrfs/074 | 2 +- tests/btrfs/076 | 2 +- tests/btrfs/091 | 3 +- tests/btrfs/104 | 2 +- tests/btrfs/123 | 2 +- tests/btrfs/126 | 2 +- tests/btrfs/136 | 2 +- tests/btrfs/139 | 2 +- tests/btrfs/153 | 2 +- tests/btrfs/171 | 6 +- tests/btrfs/179 | 2 +- tests/btrfs/180 | 2 +- tests/btrfs/190 | 2 +- tests/btrfs/192 | 4 +- tests/btrfs/193 | 2 +- tests/btrfs/210 | 2 +- tests/btrfs/224 | 6 +- tests/btrfs/230 | 2 +- tests/btrfs/232 | 4 +- tests/btrfs/261 | 2 +- tests/btrfs/283 | 8 ++ tests/btrfs/286 | 2 +- tests/btrfs/295 | 2 + tests/btrfs/298 | 53 +++++++++++++ tests/btrfs/298.out | 2 + tests/btrfs/301 | 444 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/301.out | 18 +++++ tests/ext4/057 | 2 +- tests/ext4/307 | 2 +- tests/generic/068 | 2 +- tests/generic/269 | 2 +- tests/generic/409 | 2 +- tests/generic/410 | 2 +- tests/generic/411 | 2 +- tests/generic/589 | 2 +- tests/xfs/051 | 2 +- tests/xfs/057 | 2 +- tests/xfs/297 | 2 +- tests/xfs/305 | 2 +- tests/xfs/538 | 2 +- 61 files changed, 734 insertions(+), 102 deletions(-) create mode 100755 tests/btrfs/298 create mode 100644 tests/btrfs/298.out create mode 100755 tests/btrfs/301 create mode 100644 tests/btrfs/301.out . Date: Wed, 10 Jan 2024 05:59:43 +0530 From: Anand Jain To: zlang@kernel.org Cc: fstests@vger.kernel.org, Linux BTRFS Development Subject: [GIT PULL] fstests: btrfs changes for for-next v2024.01.10 Zorro, Please pull this branch containing test cases for RST and snapshot delete. Thx. The following changes since commit 17324dbc7743902aec349d12ccad91b3cb6005c5: fstests: btrfs: use proper filter for subvolume deletion (2023-12-24 03:14:21 +0800) are available in the Git repository at: https://github.com/asj/fstests/tree/staged-20240110 for you to fetch changes up to e50e5d97b2a217564f27bdebbe1e358eb93653d0: btrfs: test snapshotting a deleted subvolume (2024-01-10 04:39:02 +0530) ---------------------------------------------------------------- Anand Jain (1): common: add _filter_trailing_whitespace Johannes Thumshirn (9): fstests: doc: add new raid-stripe-tree group common: add _require_btrfs_no_nodatacow helper common: add _require_btrfs_free_space_tree common: add filter for btrfs raid-stripe dump btrfs: add fstest for stripe-tree metadata with 4k write btrfs: add fstest for 8k write spanning two stripes on raid-stripe-tree btrfs: add fstest for writing to a file at an offset with RST btrfs: add fstests to write 128k to a RST filesystem btrfs: add fstest for overwriting a file partially with RST Omar Sandoval (1): btrfs: test snapshotting a deleted subvolume .gitignore | 1 + common/btrfs | 17 ++++++++++++ common/filter | 5 ++++ common/filter.btrfs | 15 ++++++++++ doc/group-names.txt | 1 + src/Makefile | 2 +- src/t_snapshot_deleted_subvolume.c | 102 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/304 | 58 +++++++++++++++++++++++++++++++++++++++ tests/btrfs/304.out | 58 +++++++++++++++++++++++++++++++++++++++ tests/btrfs/305 | 63 ++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/305.out | 82 +++++++++++++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/306 | 61 +++++++++++++++++++++++++++++++++++++++++ tests/btrfs/306.out | 75 ++++++++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/307 | 58 +++++++++++++++++++++++++++++++++++++++ tests/btrfs/307.out | 65 +++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/308 | 62 +++++++++++++++++++++++++++++++++++++++++ tests/btrfs/308.out | 106 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/309 | 27 ++++++++++++++++++ tests/btrfs/309.out | 2 ++ 19 files changed, 859 insertions(+), 1 deletion(-) create mode 100644 src/t_snapshot_deleted_subvolume.c create mode 100755 tests/btrfs/304 create mode 100644 tests/btrfs/304.out create mode 100755 tests/btrfs/305 create mode 100644 tests/btrfs/305.out create mode 100755 tests/btrfs/306 create mode 100644 tests/btrfs/306.out create mode 100755 tests/btrfs/307 create mode 100644 tests/btrfs/307.out create mode 100755 tests/btrfs/308 create mode 100644 tests/btrfs/308.out create mode 100755 tests/btrfs/309 create mode 100644 tests/btrfs/309.out . Date: Fri, 1 Mar 2024 12:44:08 +0530 From: Anand Jain To: fstests@vger.kernel.org Cc: linux-btrfs@vger.kernel.org Subject: [GIT PULL] fstests: btrfs changes for for-next v2024.03.01 Zorro, Please pull this branch containing test cases for tempfsid and a few other miscellaneous test cases. Thank you. The following changes since commit 386c7b6aa69ebe8017a4728a994f80d55c660de4: xfs/122: fix for xfs_attr_shortform removal in 6.8 (2024-02-09 13:27:17 +0800) are available in the Git repository at: https://github.com/asj/fstests.git staged-20240301 for you to fetch changes up to bbc42ac1031c70e40b1191ac747697f0a3e0a5a5: btrfs: check conversion of zoned fileystems (2024-03-01 12:28:29 +0800) ---------------------------------------------------------------- Anand Jain (10): assign SCRATCH_DEV_POOL to an array btrfs: introduce tempfsid test group btrfs: create a helper function, check_fsid(), to verify the tempfsid btrfs: verify that subvolume mounts are unaffected by tempfsid btrfs: check if cloned device mounts with tempfsid btrfs: test case prerequisite _require_btrfs_mkfs_uuid_option btrfs: introduce helper for creating cloned devices with mkfs btrfs: verify tempfsid clones using mkfs btrfs: validate send-receive operation with tempfsid. btrfs: test tempfsid with device add, seed, and balance Filipe Manana (1): btrfs: test incremental send on sparse file with trailing hole Johannes Thumshirn (3): filter.brtfs: add filter for conversion filter.btrfs: add filter for btrfs device add btrfs: check conversion of zoned fileystems Qu Wenruo (3): btrfs: validate inconsitent qgroup won't leak reserved data space btrfs: btrfs/224 do not assign snapshot to a subvolume qgroup btrfs: detect regular qgroup for older kernels correctly common/btrfs | 76 ++++++++++++++++++++++++++++++++++++++++++- common/filter.btrfs | 15 +++++++++ common/rc | 18 ++++++++--- doc/group-names.txt | 1 + tests/btrfs/224 | 6 ++-- tests/btrfs/303 | 92 +++++++++++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/303.out | 24 ++++++++++++++ tests/btrfs/311 | 87 ++++++++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/311.out | 24 ++++++++++++++ tests/btrfs/312 | 78 +++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/312.out | 19 +++++++++++ tests/btrfs/313 | 52 ++++++++++++++++++++++++++++++ tests/btrfs/313.out | 16 ++++++++++ tests/btrfs/314 | 78 +++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/314.out | 23 ++++++++++++++ tests/btrfs/315 | 91 ++++++++++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/315.out | 10 ++++++ tests/btrfs/316 | 59 ++++++++++++++++++++++++++++++++++ tests/btrfs/316.out | 2 ++ tests/btrfs/317 | 67 ++++++++++++++++++++++++++++++++++++++ tests/btrfs/317.out | 9 ++++++ 21 files changed, 839 insertions(+), 8 deletions(-) create mode 100755 tests/btrfs/303 create mode 100644 tests/btrfs/303.out create mode 100755 tests/btrfs/311 create mode 100644 tests/btrfs/311.out create mode 100755 tests/btrfs/312 create mode 100644 tests/btrfs/312.out create mode 100755 tests/btrfs/313 create mode 100644 tests/btrfs/313.out create mode 100755 tests/btrfs/314 create mode 100644 tests/btrfs/314.out create mode 100755 tests/btrfs/315 create mode 100644 tests/btrfs/315.out create mode 100755 tests/btrfs/316 create mode 100644 tests/btrfs/316.out create mode 100755 tests/btrfs/317 create mode 100644 tests/btrfs/317.out . Date: Fri, 8 Mar 2024 20:15:32 +0530 From: Anand Jain To: zlang@redhat.com Cc: fstests@vger.kernel.org, linux-btrfs@vger.kernel.org Subject: [GIT PULL] fstests: btrfs changes for for-next v2024.03.08 Zorro, Please pull this branch containing bug fixes. This changes are based on your branch for-next as below. Thank you. The following changes since commit 9b6df9a01ac8ee3f28a2a24d71e45792e21b6d48: btrfs/016: fix a false alert due to xattrs mismatch (2024-03-01 19:24:16 +0800) are available in the Git repository at: https://github.com/asj/fstests.git staged-20240308 for you to fetch changes up to 9a03e88a04b6cf6e161c8902a3a523ca22601277: btrfs: test normal qgroup operations in a compress friendly way (2024-03-08 22:31:51 +0800) ---------------------------------------------------------------- Anand Jain (1): common/rc: specify required device size Filipe Manana (1): btrfs: fix grep warning at _require_btrfs_mkfs_uuid_option() Josef Bacik (8): btrfs/011: increase the runtime for replace cancel btrfs/012: adjust how we populate the fs to convert btrfs/131: don't run with subpage blocksizes btrfs/213: make the test more reliable btrfs/271: adjust failure condition btrfs/287,btrfs/293: filter all btrfs subvolume delete calls btrfs/291: remove image file after teardown btrfs: test normal qgroup operations in a compress friendly way check | 6 --- common/btrfs | 2 +- common/rc | 9 ++++- tests/btrfs/011 | 9 ++++- tests/btrfs/012 | 14 ++++--- tests/btrfs/022 | 86 ++--------------------------------------- tests/btrfs/131 | 4 ++ tests/btrfs/213 | 20 +++++----- tests/btrfs/271 | 11 +++--- tests/btrfs/287 | 4 +- tests/btrfs/287.out | 2 +- tests/btrfs/291 | 2 +- tests/btrfs/293 | 6 +-- tests/btrfs/293.out | 4 +- tests/btrfs/320 | 107 ++++++++++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/320.out | 2 + 16 files changed, 164 insertions(+), 124 deletions(-) create mode 100755 tests/btrfs/320 create mode 100644 tests/btrfs/320.out . Date: Sun, 24 Mar 2024 20:15:42 +0530 From: Anand Jain To: fstests@vger.kernel.org Cc: linux-btrfs@vger.kernel.org, fdmanana@kernel.org Subject: [GIT PULL] fstests: btrfs changes for for-next v2024.03.24 Zorro, Some of the patches here were part of a group where other patches might need revision. However, these patches are ready for integration. Please pull. Thank you. The following changes since commit ec5b77f70e602b2312bd25ac9d6f7c507d47f2a6: fstests: add missing commit IDs to some tests (2024-03-13 23:56:38 +0800) are available in the Git repository at: https://github.com/asj/fstests/tree/staged-20240324 for you to fetch changes up to 805eeea406a7cd78ab76f91cb061bce7e9a3e83c: fstests: btrfs/195: skip raid setups not in the profile configs (2024-03-24 19:57:42 +0800) ---------------------------------------------------------------- Anand Jain (2): common/btrfs: introduce _require_btrfs_send_version generic: test mount fails on physical device with configured dm volume Boris Burkov (3): btrfs/320: skip -O squota runs btrfs/277: specify protocol version 3 for verity send btrfs/316: use rescan wrapper David Sterba (1): common/rc: use proper temporary file path in _repair_test_fs() Josef Bacik (3): btrfs/131,btrfs/172,btrfs/206: add check for block-group-tree feature in btrfs btrfs/330: add test to validate ro/rw subvol mounting fstests: btrfs/195: skip raid setups not in the profile configs common/btrfs | 20 +++++++++++++---- common/rc | 4 ++-- tests/btrfs/131 | 2 ++ tests/btrfs/172 | 3 +++ tests/btrfs/195 | 8 +++++++ tests/btrfs/206 | 3 +++ tests/btrfs/277 | 3 ++- tests/btrfs/281 | 2 +- tests/btrfs/284 | 2 +- tests/btrfs/316 | 3 ++- tests/btrfs/320 | 6 ++++-- tests/btrfs/330 | 53 +++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/330.out | 6 ++++++ tests/generic/741 | 60 +++++++++++++++++++++++++++++++++++++++++++++++++++ tests/generic/741.out | 3 +++ 15 files changed, 166 insertions(+), 12 deletions(-) create mode 100755 tests/btrfs/330 create mode 100644 tests/btrfs/330.out create mode 100755 tests/generic/741 create mode 100644 tests/generic/741.out . Date: Wed, 3 Apr 2024 15:24:14 +0800 From: Anand Jain To: fstests@vger.kernel.org Cc: linux-btrfs@vger.kernel.org Subject: [GIT PULL] fstests: btrfs changes for for-next v2024.04.03 Zorro, Please pull this branch, which includes cleanups for background processes initiated by the testcase upon its exit. Thank you. The following changes since commit e72e052d56c3f05e533f4b67056f86931f688368: generic: test MADV_POPULATE_READ with IO errors (2024-03-30 15:48:12 +0800) are available in the Git repository at: https://github.com/asj/fstests.git staged-20240403 for you to fetch changes up to 8aab1f1663031cccb326ffbcb087b81bfb629df8: common/btrfs: lookup running processes using pgrep (2024-04-03 15:09:01 +0800) ---------------------------------------------------------------- Anand Jain (1): common/btrfs: lookup running processes using pgrep Filipe Manana (10): btrfs: add helper to kill background process running _btrfs_stress_balance btrfs/028: use the helper _btrfs_kill_stress_balance_pid btrfs/028: removed redundant sync and scratch filesystem unmount btrfs: add helper to kill background process running _btrfs_stress_scrub btrfs: add helper to kill background process running _btrfs_stress_defrag btrfs: add helper to kill background process running _btrfs_stress_remount_compress btrfs: add helper to kill background process running _btrfs_stress_replace btrfs: add helper to stop background process running _btrfs_stress_subvolume btrfs: remove stop file early at _btrfs_stress_subvolume btrfs/06[0-9]..07[0-4]: kill all background tasks when test is killed/interrupted common/btrfs | 84 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/028 | 16 ++++------- tests/btrfs/060 | 33 ++++++++++++++++------- tests/btrfs/061 | 30 ++++++++++++++------- tests/btrfs/062 | 30 ++++++++++++++------- tests/btrfs/063 | 30 ++++++++++++++------- tests/btrfs/064 | 30 ++++++++++++++------- tests/btrfs/065 | 33 ++++++++++++++++------- tests/btrfs/066 | 33 ++++++++++++++++------- tests/btrfs/067 | 33 ++++++++++++++++------- tests/btrfs/068 | 33 ++++++++++++++++------- tests/btrfs/069 | 31 ++++++++++++++------- tests/btrfs/070 | 31 ++++++++++++++------- tests/btrfs/071 | 31 ++++++++++++++------- tests/btrfs/072 | 31 ++++++++++++++------- tests/btrfs/073 | 30 ++++++++++++++------- tests/btrfs/074 | 30 ++++++++++++++------- tests/btrfs/132 | 2 +- tests/btrfs/255 | 8 ++---- 19 files changed, 418 insertions(+), 161 deletions(-) . Date: Sun, 14 Apr 2024 09:12:02 +0800 From: Anand Jain To: zlang@kernel.org Cc: fstests@vger.kernel.org, linux-btrfs@vger.kernel.org Subject: [GIT PULL] fstests: btrfs changes staged-20240414 Please pull this branch containing changes as below. These patches are on top of my last PR branch staged-20240403. Thank you. The following changes since commit 8aab1f1663031cccb326ffbcb087b81bfb629df8: common/btrfs: lookup running processes using pgrep (2024-04-03 15:09:01 +0800) are available in the Git repository at: https://github.com/asj/fstests.git staged-20240414 for you to fetch changes up to 943bbbc1ce0a3f8af862a7f9f11ecec00146edfe: btrfs: remove useless comments (2024-04-14 08:38:14 +0800) ---------------------------------------------------------------- Anand Jain (5): generic: move btrfs clone device testcase to the generic group common/btrfs: refactor _require_btrfs_corrupt_block to check option btrfs/290: fix btrfs_corrupt_block options common/verity: fix btrfs-corrupt-block -v option btrfs/125 197 198: cleanup using SCRATCH_DEV_NAME Boris Burkov (1): btrfs: new test for devt change between mounts David Sterba (1): btrfs: remove useless comments Josef Bacik (3): fstests: change btrfs/197 and btrfs/198 golden output fstests: change how we test for supported raid configs fstests: update tests to skip unsupported raid profile types common/btrfs | 45 +++++++++++++-- common/config | 1 + common/rc | 14 +++++ common/verity | 5 +- tests/btrfs/001 | 2 - tests/btrfs/002 | 2 - tests/btrfs/003 | 1 - tests/btrfs/004 | 2 - tests/btrfs/005 | 2 - tests/btrfs/006 | 4 -- tests/btrfs/007 | 2 - tests/btrfs/008 | 2 - tests/btrfs/009 | 2 - tests/btrfs/011 | 2 - tests/btrfs/012 | 4 -- tests/btrfs/013 | 2 - tests/btrfs/014 | 2 - tests/btrfs/015 | 2 - tests/btrfs/016 | 2 - tests/btrfs/017 | 3 - tests/btrfs/018 | 2 - tests/btrfs/019 | 2 - tests/btrfs/020 | 2 - tests/btrfs/021 | 2 - tests/btrfs/022 | 1 - tests/btrfs/023 | 2 - tests/btrfs/024 | 2 - tests/btrfs/025 | 2 - tests/btrfs/026 | 2 - tests/btrfs/027 | 3 - tests/btrfs/028 | 2 - tests/btrfs/029 | 2 - tests/btrfs/030 | 2 - tests/btrfs/031 | 2 - tests/btrfs/032 | 2 - tests/btrfs/033 | 2 - tests/btrfs/034 | 2 - tests/btrfs/035 | 2 - tests/btrfs/036 | 2 - tests/btrfs/037 | 2 - tests/btrfs/038 | 2 - tests/btrfs/039 | 2 - tests/btrfs/040 | 2 - tests/btrfs/041 | 2 - tests/btrfs/042 | 1 - tests/btrfs/043 | 2 - tests/btrfs/044 | 2 - tests/btrfs/045 | 2 - tests/btrfs/046 | 2 - tests/btrfs/047 | 3 - tests/btrfs/048 | 2 - tests/btrfs/049 | 2 - tests/btrfs/050 | 2 - tests/btrfs/051 | 2 - tests/btrfs/052 | 2 - tests/btrfs/053 | 2 - tests/btrfs/054 | 2 - tests/btrfs/055 | 2 - tests/btrfs/056 | 2 - tests/btrfs/057 | 2 - tests/btrfs/058 | 2 - tests/btrfs/059 | 2 - tests/btrfs/060 | 2 - tests/btrfs/061 | 2 - tests/btrfs/062 | 2 - tests/btrfs/063 | 2 - tests/btrfs/064 | 2 - tests/btrfs/065 | 2 - tests/btrfs/066 | 2 - tests/btrfs/067 | 2 - tests/btrfs/068 | 2 - tests/btrfs/069 | 2 - tests/btrfs/070 | 2 - tests/btrfs/071 | 2 - tests/btrfs/072 | 2 - tests/btrfs/073 | 2 - tests/btrfs/074 | 2 - tests/btrfs/075 | 2 - tests/btrfs/076 | 2 - tests/btrfs/077 | 2 - tests/btrfs/078 | 2 - tests/btrfs/079 | 2 - tests/btrfs/080 | 2 - tests/btrfs/081 | 2 - tests/btrfs/082 | 2 - tests/btrfs/083 | 2 - tests/btrfs/084 | 2 - tests/btrfs/085 | 2 - tests/btrfs/086 | 2 - tests/btrfs/087 | 2 - tests/btrfs/088 | 2 - tests/btrfs/089 | 4 -- tests/btrfs/090 | 4 -- tests/btrfs/091 | 3 - tests/btrfs/092 | 2 - tests/btrfs/093 | 2 - tests/btrfs/094 | 2 - tests/btrfs/095 | 2 - tests/btrfs/096 | 2 - tests/btrfs/097 | 2 - tests/btrfs/098 | 2 - tests/btrfs/099 | 3 - tests/btrfs/100 | 1 - tests/btrfs/101 | 1 - tests/btrfs/102 | 2 - tests/btrfs/103 | 2 - tests/btrfs/104 | 2 - tests/btrfs/105 | 2 - tests/btrfs/106 | 2 - tests/btrfs/107 | 3 - tests/btrfs/108 | 2 - tests/btrfs/109 | 2 - tests/btrfs/110 | 2 - tests/btrfs/111 | 2 - tests/btrfs/112 | 2 - tests/btrfs/113 | 2 - tests/btrfs/114 | 2 - tests/btrfs/115 | 2 - tests/btrfs/116 | 2 - tests/btrfs/117 | 2 - tests/btrfs/118 | 2 - tests/btrfs/119 | 2 - tests/btrfs/120 | 2 - tests/btrfs/121 | 2 - tests/btrfs/122 | 2 - tests/btrfs/123 | 4 -- tests/btrfs/124 | 3 - tests/btrfs/125 | 11 ++-- tests/btrfs/126 | 4 -- tests/btrfs/127 | 2 - tests/btrfs/128 | 2 - tests/btrfs/129 | 2 - tests/btrfs/130 | 4 -- tests/btrfs/131 | 3 - tests/btrfs/132 | 4 -- tests/btrfs/133 | 2 - tests/btrfs/134 | 2 - tests/btrfs/135 | 2 - tests/btrfs/136 | 4 -- tests/btrfs/137 | 2 - tests/btrfs/138 | 3 - tests/btrfs/139 | 1 - tests/btrfs/140 | 4 -- tests/btrfs/141 | 4 -- tests/btrfs/142 | 4 -- tests/btrfs/143 | 4 -- tests/btrfs/144 | 2 - tests/btrfs/145 | 2 - tests/btrfs/146 | 2 - tests/btrfs/147 | 2 - tests/btrfs/148 | 5 +- tests/btrfs/149 | 2 - tests/btrfs/150 | 4 -- tests/btrfs/151 | 4 -- tests/btrfs/152 | 2 - tests/btrfs/153 | 4 -- tests/btrfs/154 | 3 - tests/btrfs/155 | 2 - tests/btrfs/156 | 4 -- tests/btrfs/157 | 6 +- tests/btrfs/158 | 6 +- tests/btrfs/159 | 2 - tests/btrfs/160 | 2 - tests/btrfs/161 | 4 -- tests/btrfs/162 | 4 -- tests/btrfs/163 | 4 -- tests/btrfs/164 | 3 - tests/btrfs/165 | 2 - tests/btrfs/166 | 2 - tests/btrfs/167 | 4 -- tests/btrfs/168 | 2 - tests/btrfs/169 | 2 - tests/btrfs/170 | 2 - tests/btrfs/171 | 2 - tests/btrfs/172 | 4 -- tests/btrfs/176 | 4 -- tests/btrfs/177 | 1 - tests/btrfs/178 | 2 - tests/btrfs/179 | 4 -- tests/btrfs/180 | 4 -- tests/btrfs/181 | 4 -- tests/btrfs/182 | 4 -- tests/btrfs/183 | 2 - tests/btrfs/184 | 2 - tests/btrfs/185 | 2 - tests/btrfs/186 | 2 - tests/btrfs/187 | 2 - tests/btrfs/188 | 2 - tests/btrfs/189 | 2 - tests/btrfs/190 | 4 -- tests/btrfs/191 | 2 - tests/btrfs/192 | 4 -- tests/btrfs/193 | 4 -- tests/btrfs/194 | 4 -- tests/btrfs/195 | 4 -- tests/btrfs/196 | 4 -- tests/btrfs/197 | 30 +++++----- tests/btrfs/197.out | 25 +-------- tests/btrfs/198 | 29 ++++++---- tests/btrfs/198.out | 25 +-------- tests/btrfs/199 | 4 -- tests/btrfs/200 | 2 - tests/btrfs/201 | 2 - tests/btrfs/203 | 2 - tests/btrfs/204 | 4 -- tests/btrfs/205 | 2 - tests/btrfs/206 | 2 - tests/btrfs/207 | 1 - tests/btrfs/208 | 2 - tests/btrfs/209 | 2 - tests/btrfs/210 | 4 -- tests/btrfs/211 | 2 - tests/btrfs/212 | 4 -- tests/btrfs/213 | 2 - tests/btrfs/214 | 3 - tests/btrfs/215 | 3 - tests/btrfs/216 | 2 - tests/btrfs/217 | 4 -- tests/btrfs/218 | 4 -- tests/btrfs/219 | 3 - tests/btrfs/220 | 2 - tests/btrfs/221 | 2 - tests/btrfs/222 | 2 - tests/btrfs/223 | 2 - tests/btrfs/224 | 4 -- tests/btrfs/225 | 4 -- tests/btrfs/226 | 2 - tests/btrfs/227 | 2 - tests/btrfs/228 | 4 -- tests/btrfs/229 | 2 - tests/btrfs/230 | 3 - tests/btrfs/231 | 2 - tests/btrfs/232 | 3 - tests/btrfs/233 | 2 - tests/btrfs/234 | 2 - tests/btrfs/235 | 2 - tests/btrfs/236 | 2 - tests/btrfs/237 | 3 - tests/btrfs/238 | 4 -- tests/btrfs/239 | 2 - tests/btrfs/240 | 2 - tests/btrfs/241 | 2 - tests/btrfs/242 | 2 - tests/btrfs/243 | 2 - tests/btrfs/244 | 6 -- tests/btrfs/245 | 3 - tests/btrfs/246 | 2 - tests/btrfs/247 | 4 -- tests/btrfs/248 | 6 -- tests/btrfs/249 | 6 -- tests/btrfs/250 | 3 - tests/btrfs/251 | 4 -- tests/btrfs/252 | 2 - tests/btrfs/254 | 2 - tests/btrfs/255 | 1 - tests/btrfs/256 | 3 - tests/btrfs/257 | 4 -- tests/btrfs/258 | 3 - tests/btrfs/259 | 4 -- tests/btrfs/260 | 4 -- tests/btrfs/262 | 3 - tests/btrfs/263 | 4 -- tests/btrfs/264 | 3 - tests/btrfs/265 | 3 - tests/btrfs/266 | 3 - tests/btrfs/267 | 3 - tests/btrfs/272 | 1 - tests/btrfs/273 | 3 - tests/btrfs/275 | 2 - tests/btrfs/277 | 4 -- tests/btrfs/278 | 1 - tests/btrfs/282 | 1 - tests/btrfs/284 | 1 - tests/btrfs/286 | 4 -- tests/btrfs/288 | 4 -- tests/btrfs/289 | 3 - tests/btrfs/290 | 27 +++++---- tests/btrfs/291 | 2 - tests/btrfs/292 | 4 -- tests/btrfs/294 | 4 -- tests/btrfs/296 | 1 - tests/btrfs/297 | 10 ++++ tests/btrfs/299 | 2 - tests/btrfs/301 | 4 -- tests/btrfs/310 | 6 -- tests/btrfs/311 | 1 - tests/btrfs/312 | 153 ++++++++++++++++++++++++++++++-------------------- tests/btrfs/312.out | 19 +------ tests/btrfs/320 | 1 - tests/generic/744 | 87 ++++++++++++++++++++++++++++ tests/generic/744.out | 4 ++ 291 files changed, 310 insertions(+), 876 deletions(-) create mode 100755 tests/generic/744 create mode 100644 tests/generic/744.out . Date: Wed, 24 Apr 2024 06:06:43 +0800 From: Anand Jain To: zlang@kernel.org Cc: fstests@vger.kernel.org, linux-btrfs@vger.kernel.org Subject: [GIT PULL] fstests: btrfs changes staged-20240418 (I just realized that the previous attempt to send this PR failed. Resending it now.) Zorro, Several of the btrfs test cases were failing due to a change in the golden output. The commits here fix them. These patches are on top of the last PR branch staged-20240414. Thank you. The following changes since commit 943bbbc1ce0a3f8af862a7f9f11ecec00146edfe: btrfs: remove useless comments (2024-04-14 08:38:14 +0800) are available in the Git repository at: https://github.com/asj/fstests.git staged-20240418 for you to fetch changes up to 6fc18c4142c9470013dae598cdc29a2f67887a94: fstests: btrfs: use _btrfs for 'subvolume snapshot' command (2024-04-18 20:16:21 +0800) ---------------------------------------------------------------- Qu Wenruo (2): fstests: btrfs: rename _run_btrfs_util_prog to _btrfs fstests: btrfs: use _btrfs for 'subvolume snapshot' command common/btrfs | 15 ++++++++------- tests/btrfs/001 | 2 +- tests/btrfs/001.out | 1 - tests/btrfs/004 | 2 +- tests/btrfs/007 | 6 +++--- tests/btrfs/011 | 10 +++++----- tests/btrfs/017 | 6 +++--- tests/btrfs/022 | 6 +++--- tests/btrfs/025 | 20 ++++++++++---------- tests/btrfs/028 | 2 +- tests/btrfs/030 | 12 ++++++------ tests/btrfs/034 | 12 ++++++------ tests/btrfs/038 | 20 ++++++++++---------- tests/btrfs/039 | 12 ++++++------ tests/btrfs/040 | 12 ++++++------ tests/btrfs/041 | 2 +- tests/btrfs/042 | 10 +++++----- tests/btrfs/043 | 12 ++++++------ tests/btrfs/044 | 12 ++++++------ tests/btrfs/045 | 12 ++++++------ tests/btrfs/046 | 14 +++++++------- tests/btrfs/048 | 16 ++++++++-------- tests/btrfs/050 | 6 +++--- tests/btrfs/051 | 6 +++--- tests/btrfs/052 | 2 +- tests/btrfs/053 | 12 ++++++------ tests/btrfs/054 | 18 +++++++++--------- tests/btrfs/057 | 6 +++--- tests/btrfs/058 | 4 ++-- tests/btrfs/077 | 12 ++++++------ tests/btrfs/080 | 2 +- tests/btrfs/083 | 12 ++++++------ tests/btrfs/084 | 12 ++++++------ tests/btrfs/085 | 4 ++-- tests/btrfs/087 | 12 ++++++------ tests/btrfs/090 | 2 +- tests/btrfs/091 | 8 ++++---- tests/btrfs/092 | 12 ++++++------ tests/btrfs/094 | 12 ++++++------ tests/btrfs/097 | 12 ++++++------ tests/btrfs/099 | 4 ++-- tests/btrfs/100 | 6 +++--- tests/btrfs/101 | 6 +++--- tests/btrfs/104 | 10 +++++----- tests/btrfs/105 | 14 +++++++------- tests/btrfs/108 | 6 +++--- tests/btrfs/109 | 6 +++--- tests/btrfs/110 | 16 ++++++++-------- tests/btrfs/111 | 20 ++++++++++---------- tests/btrfs/117 | 18 +++++++++--------- tests/btrfs/118 | 8 ++++---- tests/btrfs/119 | 6 +++--- tests/btrfs/120 | 4 ++-- tests/btrfs/121 | 2 +- tests/btrfs/122 | 10 +++++----- tests/btrfs/123 | 2 +- tests/btrfs/124 | 10 +++++----- tests/btrfs/125 | 18 +++++++++--------- tests/btrfs/126 | 4 ++-- tests/btrfs/127 | 12 ++++++------ tests/btrfs/128 | 12 ++++++------ tests/btrfs/129 | 12 ++++++------ tests/btrfs/130 | 2 +- tests/btrfs/139 | 6 +++--- tests/btrfs/152 | 14 ++++++-------- tests/btrfs/152.out | 2 -- tests/btrfs/153 | 4 ++-- tests/btrfs/161 | 4 ++-- tests/btrfs/162 | 6 +++--- tests/btrfs/163 | 12 ++++++------ tests/btrfs/164 | 12 ++++++------ tests/btrfs/166 | 2 +- tests/btrfs/167 | 2 +- tests/btrfs/168 | 6 ++---- tests/btrfs/168.out | 2 -- tests/btrfs/169 | 6 ++---- tests/btrfs/169.out | 2 -- tests/btrfs/170 | 3 +-- tests/btrfs/170.out | 1 - tests/btrfs/187 | 6 ++---- tests/btrfs/187.out | 2 -- tests/btrfs/188 | 6 ++---- tests/btrfs/188.out | 2 -- tests/btrfs/189 | 6 ++---- tests/btrfs/189.out | 2 -- tests/btrfs/191 | 6 ++---- tests/btrfs/191.out | 2 -- tests/btrfs/200 | 6 ++---- tests/btrfs/200.out | 2 -- tests/btrfs/202 | 3 +-- tests/btrfs/202.out | 1 - tests/btrfs/203 | 6 ++---- tests/btrfs/203.out | 2 -- tests/btrfs/218 | 2 +- tests/btrfs/226 | 3 +-- tests/btrfs/226.out | 1 - tests/btrfs/272 | 14 +++++++------- tests/btrfs/273 | 6 +++--- tests/btrfs/276 | 2 +- tests/btrfs/276.out | 1 - tests/btrfs/278 | 14 +++++++------- tests/btrfs/280 | 2 +- tests/btrfs/280.out | 1 - tests/btrfs/281 | 3 +-- tests/btrfs/281.out | 1 - tests/btrfs/283 | 3 +-- tests/btrfs/283.out | 1 - tests/btrfs/287 | 6 ++---- tests/btrfs/287.out | 2 -- tests/btrfs/293 | 4 ++-- tests/btrfs/293.out | 2 -- tests/btrfs/300 | 2 +- tests/btrfs/300.out | 1 - tests/btrfs/302 | 3 +-- tests/btrfs/302.out | 1 - tests/btrfs/314 | 3 +-- tests/btrfs/314.out | 2 -- tests/btrfs/320 | 16 ++++++++-------- 118 files changed, 375 insertions(+), 435 deletions(-) . Date: Fri, 24 May 2024 12:38:14 +0800 From: Anand Jain To: zlang@redhat.com Cc: fstests@vger.kernel.org, linux-btrfs@vger.kernel.org Subject: [GIT PULL] fstests: btrfs changes for for-next staged-20240524 Zorro, Please pull this branch containing btrfs test case fixes, gathered from the ML. Thank you. The following changes since commit 9837971383733ad59ead121dcc4b13f89829d389: generic: add gc stress test (2024-05-12 20:28:48 +0800) are available in the Git repository at: https://github.com/asj/fstests.git staged-20240524 for you to fetch changes up to a42f8a6be29e0857ad3ba3a2b6952913f56db877: fstests: mkfs the scratch device if we have missing profiles (2024-05-24 12:06:43 +0800) ---------------------------------------------------------------- Josef Bacik (5): generic/352: require no compression generic/027: require no compression generic/269: require no compression btrfs/{140,141}: verify read-repair test data by md5sum fstests: mkfs the scratch device if we have missing profiles Qu Wenruo (1): fstests: btrfs/301: handle auto-removed qgroups tests/btrfs/011 | 6 ++++++ tests/btrfs/140 | 15 ++++++++++++++- tests/btrfs/140.out | 34 ---------------------------------- tests/btrfs/141 | 16 +++++++++++++++- tests/btrfs/141.out | 34 ---------------------------------- tests/btrfs/301 | 14 +++++++++++--- tests/generic/027 | 4 ++++ tests/generic/269 | 2 +- tests/generic/352 | 4 ++++ 9 files changed, 55 insertions(+), 74 deletions(-) . Date: Fri, 12 Jul 2024 22:11:32 +0530 From: Anand Jain To: zlang@kernel.org Cc: fstests@vger.kernel.org, linux-btrfs@vger.kernel.org Subject: [GIT PULL] fstests: btrfs changes for for-next v2024.07.13 Zorro, Please pull this branch, which contains a small set of fixes and a new squota testcase. Thank you. The following changes since commit 98611b1acce44dca91c4654fcb339b6f95c2c82a: generic: test creating and removing symlink xattrs (2024-06-23 23:04:36 +0800) are available in the Git repository at: https://github.com/asj/fstests.git staged-20240713 for you to fetch changes up to 8e0a68f2cbe9cc2698110ac85765a0c4681b290f: btrfs: fix _require_btrfs_send_version to detect btrfs-progs support (2024-07-12 21:59:22 +0530) ---------------------------------------------------------------- Boris Burkov (1): btrfs: add test for subvolid reuse with squota Filipe Manana (1): btrfs: fix _require_btrfs_send_version to detect btrfs-progs support Johannes Thumshirn (1): btrfs: update golden output of RST test cases common/btrfs | 20 ++++++++++++++++---- tests/btrfs/304.out | 9 +++------ tests/btrfs/305.out | 24 ++++++++---------------- tests/btrfs/306.out | 18 ++++++------------ tests/btrfs/307.out | 15 +++++---------- tests/btrfs/308.out | 39 +++++++++++++-------------------------- tests/btrfs/331 | 45 +++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/331.out | 2 ++ 8 files changed, 98 insertions(+), 74 deletions(-) create mode 100755 tests/btrfs/331 create mode 100644 tests/btrfs/331.out . Date: Fri, 26 Jul 2024 15:54:25 +0800 From: Anand Jain To: zlang@kernel.org Cc: fstests@vger.kernel.org, linux-btrfs@vger.kernel.org Subject: [GIT PULL] fstests: btrfs changes for for-next staged-25072024 Zorro, Please pull this branch containing a new test case, btrfs/312 (compress send testcase), and a few other miscellaneous fixes for btrfs test cases. Thank you. The following changes since commit b3b323777a54b6883d3254c06cf0a840e80e2465: btrfs/081: wait for reader process to exit before cycle mounting (2024-07-13 03:05:35 +0800) are available in the Git repository at: https://github.com/asj/fstests.git staged-25072024 for you to fetch changes up to 02a689b7aa074a80427e11d4a0cab90e6e8e5985: btrfs: properly shutdown subvolume stress worker to avoid umount failures (2024-07-25 19:09:33 +0800) ---------------------------------------------------------------- David Sterba (1): btrfs/220: remove integrity checker bits Filipe Manana (2): btrfs: test a compressed send stream scenario that triggered a read corruption btrfs: properly shutdown subvolume stress worker to avoid umount failures Qu Wenruo (1): fstests: btrfs/012: fix a false alert due to socket/pipe files common/btrfs | 2 + tests/btrfs/012 | 29 +++++++------ tests/btrfs/012.out | 6 +++ tests/btrfs/060 | 9 ++-- tests/btrfs/065 | 9 ++-- tests/btrfs/066 | 9 ++-- tests/btrfs/067 | 9 ++-- tests/btrfs/068 | 9 ++-- tests/btrfs/220 | 5 --- tests/btrfs/312 | 115 ++++++++++++++++++++++++++++++++++++++++++++++++++++ tests/btrfs/312.out | 7 ++++ 11 files changed, 172 insertions(+), 37 deletions(-) create mode 100755 tests/btrfs/312 create mode 100644 tests/btrfs/312.out .