International Conference on Learning Representations · 2023
Oct 2023
Zeyu Yun, Juexiao Zhang, B. Olshausen et al.
Apply this framework when working with irregular or non-grid data like gene expressions or neural spikes where standard CNNs fail. It eliminates the need for manual spatial priors or domain-specific stationarity assumpti…
AI Summary
arXiv.org · 2023
Apr 2023
Randall Balestriero, Mark Ibrahim, Vlad Sobal et al.
SSL training is notoriously unstable and sensitive to hyperparameters. Use the provided recipes to select batch sizes and learning rates tailored to your specific architecture to avoid costly trial-and-error.…
AI Summary
2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2023
Jun 2023
Y. Wang, Jonas Pfeiffer, Nicolas Carion et al.
Leverage frozen English-centric weights with adapters to adapt to new languages. This approach preserves high-quality visual-textual alignment while significantly reducing the computational cost of training from scratch.…
AI Summary
Neural Information Processing Systems · 2023
Jul 2023
G. Mialon, Q. Garrido, Hannah Lawrence et al.
Joint embedding SSL framework for general PDE representations. Robust learning from heterogeneous and incomplete dynamical data. Foundation for general-purpose PDE foundation models…
AI Summary
arXiv.org · 2023
Apr 2023
Shengbang Tong, Yubei Chen, Y. Ma et al.
Prioritize patch diversity over epoch count for rapid training. By increasing the number of crops per image, you can achieve competitive representations in a single epoch, drastically reducing compute costs during early-…
AI Summary
arXiv.org · 2023
Jul 2023
Adrien Bardes, J. Ponce, Yann LeCun
Unified framework for motion and content feature learning. Shared encoder architecture for flow and semantic features. Mutual optimization of flow estimation and content objectives…
AI Summary
International Conference on Learning Representations · 2023
May 2023
Xiaoxin He, X. Bresson, T. Laurent et al.
Leverage LLM-generated explanations instead of raw text embeddings to capture deeper semantic reasoning. This approach is highly effective for complex classification tasks where node relationships are nuanced and require…
AI Summary
Trans. Mach. Learn. Res. · 2023
Feb 2023
G. Mialon, Roberto Dessì, M. Lomeli et al.
Transition from pure LMs to ALMs to mitigate hallucinations. By integrating external tools like search engines or calculators, you can ensure factual accuracy that internal weights alone cannot provide.…
AI Summary
arXiv.org · 2023
Mar 2023
Ravid Shwartz-Ziv, Randall Balestriero, Kenji Kawaguchi et al.
Provides a rigorous theoretical justification for VICReg, proving it optimizes mutual information. Use this framework to justify using VICReg over contrastive methods when negative pairs are difficult to define or comput…
AI Summary
IEEE International Conference on Computer Vision · 2023
Mar 2023
Vivien A. Cabannes, L. Bottou, Yann LeCun et al.
Replace traditional class labeling with pairwise similarity queries to reduce cognitive load on annotators. It is often faster and more accurate for non-experts to identify if two items are 'the same' than to select from…
AI Summary
IEEE International Conference on Acoustics, Speech, and Signal Processing · 2023
Jun 2023
Randall Balestriero, Yann LeCun
Use this exact enumeration algorithm to benchmark the geometric complexity of deep models. It replaces unreliable sampling methods that fail to capture small affine regions in high-dimensional spaces, providing a true gr…
AI Summary
International Conference on Machine Learning · 2023
Feb 2023
Q. Garrido, Laurent Najman, Yann LeCun
Utilize the 3DIEBench dataset for large-scale benchmarking of equivariant models. It provides 2.5 million images with ground-truth transformation labels, bridging the gap between toy datasets and real-world complexity.…
AI Summary
International Conference on Machine Learning · 2023
Feb 2023
Vivien A. Cabannes, B. Kiani, Randall Balestriero et al.
Align data augmentations strictly with desired downstream features. If an augmentation removes a feature like color or texture, the model becomes invariant to it, which can degrade performance if those features are criti…
AI Summary
arXiv.org · 2024
Mar 2024
Q. Garrido, Mahmoud Assran, Nicolas Ballas et al.
{"main_contributions":"Generalizes the Joint-Embedding Predictive Architecture (JEPA) to predict global photometric transformations in latent space rather than just spatial masking. Provides a framework to control repres…
AI Summary
SAE technical paper series · 2024
Nov 2024
Artem Provodin, L. Torabi, Urs Muller et al.
Transfer learning from ImageNet to autonomous navigation. Fast adaptation using small, environment-specific datasets. Reduced computational requirements for driving model training…
AI Summary
2022 6th CAA International Conference on Vehicular Control and Intelligence (CVCI) · 2022
Oct 2022
Yongxing Cao, Bi-jun Li, Hongjuan Zhang et al.
Leverage V2I communication to bypass single-vehicle perception limits at intersections. This is critical for planning safe maneuvers in occluded environments where onboard sensors cannot detect cross-traffic or distant s…
AI Summary
Remote Sensing · 2023
Jan 2023
Xiaomin Guo, Yongxing Cao, Jian Zhou et al.
Integrate Collision Risk Maps (CR-Maps) with Gaussian sampling to handle complex, unregulated environments like university campuses. This approach significantly reduces search space and improves path safety in areas lack…
AI Summary
arXiv.org · 2023
Jul 2023
Mingjie Lu, Yuanxian Huang, Ji Liu et al.
{"main_contributions":"Introduces a framework that simultaneously detects lane centerlines and traffic elements while reasoning about their topological connections and assignments. Employs a decoupled training strategy w…
AI Summary
IEEE transactions on intelligent transportation systems (Print) · 2023
Jul 2023
Jian Zhou, Yuan Guo, Yaoan Bian et al.
Enables low-cost HD map maintenance by replacing expensive mobile mapping systems with crowdsourced monocular camera data. Use this approach to significantly reduce the operational costs of keeping autonomous vehicle map…
AI Summary