As it's debatable on which items are useful or not in Emerald, this list includes all items that can be stolen by Thief or Covet:
Wild Pokémon
Note that this list excludes all Pokémon that cannot be naturally found in the wild (Pokémon that only evolve from their pre-evolutions, gift Pokémon, etc.) or those found in Battle Facilities.
Berries
 Oran Berry — 100% on Shuckle, 50% on Pikachu, Linoone, 5% on Zigzagoon
 Rawst Berry — 100% on Vulpix, Numel
 Lum Berry — 100% on Mew
 Persim Berry — 5% on Girafarig, Kecleon
 Pecha Berry — 5% on Poochyena, Mightyena
 Sitrus Berry — 5% on Linoone
 Chesto Berry — 5% on Whismur, Loudred, Spinda
 Leppa Berry — 5% on Skitty
Evolution items
 Metal Coat — 5% on Magnemite, Magneton
 Dragon Scale — 5% on Horsea, Bagon
 King's Rock — 5% on Hariyama
 Sun Stone — 5% on Solrock
Stat-enhancing items
 Light Ball — 5% on Pikachu
 Metal Powder — 5% on Ditto
Type-enhancing items
 Twisted Spoon — 5% on Abra
 Sharp Beak — 5% on Doduo, Dodrio
 Hard Stone — 5% on Aron, Lairon
 Poison Barb — 5% on Roselia, Cacnea
 Soft Sand — 5% on Trapinch
 Spell Tag — 5% on Shuppet, Banette, Duskull
Valuable Items
 Nugget — 5% on Grimer
 Star Piece — 5% on Staryu
 Stardust — 50% on Staryu
 Yellow Shard — 5% on Chinchou
 Red Shard — 5% on Corsola
 Big Pearl — 5% on Gulpin
 Blue Shard — 5% on Clamperl
 Green Shard — 5% on Relicanth
 Heart Scale — 50% on Luvdisc
Miscellaneous held items
 Quick Claw — 5% on Sandshrew
 Everstone — 5% on Geodude, Graveler
 Smoke Ball — 5% on Koffing
Medicine
 Moomoo Milk — 100% on Miltank
 Sacred Ash — 100% on Ho-oh
Pokémon italicized are found only in the Safari Zone, and therefore cannot be naturally battled. Items that are italicized similarly cannot be obtained from a Pokémon if not from the Safari Zone.
Trainer Battles
This list excludes trainers found in the Battle Facilities.
Berries
 Oran Berry — Pokéfan Miguel's Skitty (Initial battle, first and second rematch) and Delcatty (third rematch) on Route 103, Pokéfan Isabel's Minun and Plusle (initial battle, first, second and third rematch) on Route 110, Pokéfan Kaleb's Minun and Plusle on Route 110, Pokéfan Vanessa's Pikachu on Route 121, Gym Leader Roxanne's Nosepass (Gym Battle), Gym Leader Winona's Altaria (Gym Battle)
 Sitrus Berry — Pokéfan Miguel's Delcatty (Fourth Rematch onwards) on Route 103, Pokéfan Isabel's Minun and Plusle (Fourth Rematch onwards) on Route 110, Gym Leader Roxanne's Kabuto (First Rematch), Nosepass (First Rematch onwards), and Kabutops  (Second Rematch onwards), Gym Leader Brawly's Makuhita (Gym Battle), Hariyama (First Rematch onwards), and Machamp (First Rematch onwards), Gym Leader Wattson's Manectric (Gym Battle onwards) and Magneton (First Rematch onwards), Gym Leader Norman's Slaking (Gym Battle onwards) and Gym Leader Norman's Slaking ×2 (First Rematch onwards), Gym Leader Winona's Dratini (First Rematch), Dragonair (Second and Third Rematch), and Dragonite (Fourth Rematch onwards), Gym Leaders' Tate and Liza's Lunatone (Gym Battle) and Solrock (Gym Battle onwards), Elite Four member Sidney's Absol, Elite Four member Phoebe's Dusclops, Elite Four member Glacia's Walrein, Elite Four member Drake's Salamence, Champion Wallace's Milotic, Steven Stone's Metagross at Meteor Falls
 Chesto Berry — Gym Leader Winona's Altaria (First Rematch onwards), Gym Leaders' Tate and Liza's Lunatone and Xatu (First Rematch onwards), Gym Leader Juan's Kingdra (Gym Battle onwards) and Crawdaunt (First Rematch onwards)
Type-enhancing items
 Dragon Fang — Dragon Tamer Nicolas' Shelgon (Fourth Rematch onwards)
 Black Belt — Black Belt Nob's Machamp (Fourth Rematch onwards)
 SilverPowder — Bug Maniac Jeffrey's Masquerain (Fourth Rematch onwards)
Valuable Items
 Nugget — Rich Boy Winston's Zigzagoon/Linoone on Route 104, Lady Cindy's Zigzagoon/Linoone on Route 104, Lady Sarah's Zigzagoon on Route 116, Rich Boy Dawson's Zigzagoon on Route 116
Miscellaneous held items
 White Herb — Gym Leader Flannery's Torkoal (Gym Battle onwards), Gym Leader Flannery's Camerupt and Magcargo (First Rematch onwards)
Source