656 results for Gradient (0.076 seconds)

arxiv.org/abs/1206.4453v1

Gradient flows for non-smooth interaction potentials

We deal with a nonlocal interaction equation describing the evolution of a particle density under the effect of a general symmetric pairwise interaction potential, not necessarily in convolution form. We describe the case of a convex (or λ-convex) p...

en.wikipedia.org/wiki/Valmorel

Valmorel - Wikipedia

Doucy-Combelouvière which is linked to Valmorel by ski slopes. The climb to Valmorel, over 12.7 km (7.9 mi) at a 7% gradient from Aigueblanche, completed

arxiv.org/abs/q-bio/0612012v1

Habitat width along a latitudinal gradient

We use the Chowdhury ecosystem model, one of the most complex agent-based ecological models, to test the latitude-niche breadth hypothesis, with regard to habitat width, i.e., whether tropical species generally have narrower habitats than high lati...

arxiv.org/abs/1910.01215v4

ES-MAML: Simple Hessian-Free Meta Learning

We introduce ES-MAML, a new framework for solving the model agnostic meta learning (MAML) problem based on Evolution Strategies (ES). Existing algorithms for MAML are based on policy gradients, and incur significant difficulties when attempting to es...

github.com/vicc/chameleon

vicc/chameleon

Color framework for Swift & Objective-C (Gradient colors, hexcode support, colors from images & more). (⭐ 12378)

arxiv.org/abs/2206.03155v1

The buoyancy staircase limit in surface quasigeostrophic turbulence

Surface buoyancy gradients over a quasigeostrophic fluid permit the existence of surface-trapped Rossby waves. The interplay of these Rossby waves with surface quasigeostrophic turbulence results in latitudinally inhomogeneous mixing that, under cert...

arxiv.org/abs/2601.22101v1

ECO: Quantized Training without Full-Precision Master Weights

Quantization has significantly improved the compute and memory efficiency of Large Language Model (LLM) training. However, existing approaches still rely on accumulating their updates in high-precision: concretely, gradient updates must be applied to...

arxiv.org/abs/2601.07628v2

D-PDLP: Scaling PDLP to Distributed Multi-GPU Systems

We present a distributed framework of the Primal-Dual Hybrid Gradient (PDHG) algorithm for solving massive-scale linear programming (LP) problems. Although PDHG-based solvers demonstrate strong performance on single-node GPU architectures, their appl...

arxiv.org/abs/2312.16143v2

On the Trajectories of SGD Without Replacement

This article examines the implicit regularization effect of Stochastic Gradient Descent (SGD). We consider the case of SGD without replacement, the variant typically used to optimize large-scale neural networks. We analyze this algorithm in a more re...

arxiv.org/abs/2001.08355v1

Gradient and Hessian approximations in Derivative Free Optimization

This work investigates finite differences and the use of interpolation models to obtain approximations to the first and second derivatives of a function. Here, it is shown that if a particular set of points is used in the interpolation model, then th...

arxiv.org/abs/1511.06264v1

3D numerical design of tunnel hood

This paper relates to the parametric study of tunnel hoods in order to reduce the shape, i.e the temporal gradient, of the pressure wave generated by the entry of a High speed train in tunnel. This is achieved by using an in-house three-dimensional n...

arxiv.org/abs/2006.11505v2

Blind Descent: A Prequel to Gradient Descent

We describe an alternative learning method for neural networks, which we call Blind Descent. By design, Blind Descent does not face problems like exploding or vanishing gradients. In Blind Descent, gradients are not used to guide the learning process...

arxiv.org/abs/2304.10029v1

Jedi: Entropy-based Localization and Removal of Adversarial Patches

Real-world adversarial physical patches were shown to be successful in compromising state-of-the-art models in a variety of computer vision applications. Existing defenses that are based on either input gradient or features analysis have been comprom...