Convert an abstract-chunk-store compliant store into a readable or writable stream

Archive kafka topics into SequenceFiles containing chunks of the message stream stored in S3.

---- Minecraft Crash Report ---- // Ooh. Shiny. Time: 7/4/13 11:37 PM Description: Ticking entity java.lang.OutOfMemoryError: Java heap space at net.minecraft.server.v1_6_R1.Packet56MapChunkBulk.<init>(Packet56MapChunkBulk.java:50) at net.minecraft.server.v1_6_R1.EntityPlayer.l_(EntityPlayer.java:200) at net.minecraft.server.v1_6_R1.World.entityJoinedWorld(World.java:1354) at net.minecraft.server.v1_6_R1.World.playerJoinedWorld(World.java:1335) at net.minecraft.server.v1_6_R1.World.tickEntities(World.java:1223) at net.minecraft.server.v1_6_R1.WorldServer.tickEntities(WorldServer.java:480) at net.minecraft.server.v1_6_R1.MinecraftServer.t(MinecraftServer.java:573) at net.minecraft.server.v1_6_R1.DedicatedServer.t(DedicatedServer.java:226) at net.minecraft.server.v1_6_R1.MinecraftServer.s(MinecraftServer.java:487) at net.minecraft.server.v1_6_R1.MinecraftServer.run(MinecraftServer.java:420) at net.minecraft.server.v1_6_R1.ThreadServerApplication.run(SourceFile:582) A detailed walkthrough of the error, its code path and all known details is as follows: --------------------------------------------------------------------------------------- -- Head -- Stacktrace: at net.minecraft.server.v1_6_R1.Packet56MapChunkBulk.<init>(Packet56MapChunkBulk.java:50) at net.minecraft.server.v1_6_R1.EntityPlayer.l_(EntityPlayer.java:200) at net.minecraft.server.v1_6_R1.World.entityJoinedWorld(World.java:1354) at net.minecraft.server.v1_6_R1.World.playerJoinedWorld(World.java:1335) -- Entity being ticked -- Details: Entity Type: null (net.minecraft.server.v1_6_R1.EntityPlayer) Entity ID: 28621871 Entity Name: BigMike65 Entity's Exact location: -1819.72, 63.00, -1800.48 Entity's Block location: World: (-1820,63,-1801), Chunk: (at 4,3,7 in -114,-113; contains blocks -1824,0,-1808 to -1809,255,-1793), Region: (-4,-4; contains chunks -128,-128 to -97,-97, blocks -2048,0,-2048 to -1537,255,-1537) Entity's Momentum: 0.00, 0.00, 0.00 Stacktrace: at net.minecraft.server.v1_6_R1.World.tickEntities(World.java:1223) at net.minecraft.server.v1_6_R1.WorldServer.tickEntities(WorldServer.java:480) -- Affected level -- Details: Level name: spawn All players: 1 total; [EntityPlayer['BigMike65'/28621871, l='spawn', x=-1819.72, y=63.00, z=-1800.48](BigMike65 at -1819.724397379612,63.0,-1800.4823723305442)] Chunk stats: ServerChunkCache: 697 Drop: 0 Level seed: -5786777329714971956 Level generator: ID 00 - default, ver 1. Features enabled: true Level generator options: Level spawn location: World: (-2,64,190), Chunk: (at 14,4,14 in -1,11; contains blocks -16,0,176 to -1,255,191), Region: (-1,0; contains chunks -32,0 to -1,31, blocks -512,0,0 to -1,255,511) Level time: 1302977 game time, 1334799 day time Level dimension: 0 Level storage version: 0x04ABD - Anvil Level weather: Rain time: 76667 (now: false), thunder time: 106288 (now: false) Level game mode: Game mode: survival (ID 0). Hardcore: false. Cheats: false Stacktrace: at net.minecraft.server.v1_6_R1.MinecraftServer.t(MinecraftServer.java:573) at net.minecraft.server.v1_6_R1.DedicatedServer.t(DedicatedServer.java:226) at net.minecraft.server.v1_6_R1.MinecraftServer.s(MinecraftServer.java:487) at net.minecraft.server.v1_6_R1.MinecraftServer.run(MinecraftServer.java:420) at net.minecraft.server.v1_6_R1.ThreadServerApplication.run(SourceFile:582) -- System Details -- Details: Minecraft Version: 1.6.1 Operating System: Linux (amd64) version 2.6.32-042stab076.5 Java Version: 1.7.0_07, Oracle Corporation Java VM Version: Java HotSpot(TM) 64-Bit Server VM (mixed mode), Oracle Corporation Memory: 69813448 bytes (66 MB) / 972357632 bytes (927 MB) up to 972357632 bytes (927 MB) JVM Flags: 1 total; -Xmx1024M AABB Pool Size: 14834 (830704 bytes; 0 MB) allocated, 3 (168 bytes; 0 MB) used Suspicious classes: $Proxy3, $Proxy5, $Proxy16, ...[com.avaje.ebean.EbeanServer], [com.avaje.ebean.config.dbplatform.DatabasePlatform, SQLitePlatform], [com.mysql.jdbc.NonRegisteringDriver, Driver, StringUtils, ...], [com.mysql.jdbc.exceptions.MySQLTransientException, MySQLTimeoutException, MySQLNonTransientException, ...], [com.mysql.jdbc.exceptions.jdbc4.CommunicationsException], [com.mysql.jdbc.log.Log, StandardLogger, NullLogger, ...], [com.mysql.jdbc.util.LRUCache, ReadAheadInputStream], [net.minecraft.server.v1_6_R1.ICommandListener, IMojangStatistics, ICommandHandler, ...], [org.bukkit.BlockChangeDelegate, World, Server, ...], [org.bukkit.block.BlockState, BlockFace, Block, ...], [org.bukkit.command.CommandSender, RemoteConsoleCommandSender, CommandException, ...], [org.bukkit.command.defaults.VanillaCommand, SaveCommand, SaveOnCommand, ...], [org.bukkit.configuration.ConfigurationSection, Configuration, MemorySection, ...], [org.bukkit.configuration.file.FileConfiguration, YamlConfiguration, FileConfigurationOptions, ...], [org.bukkit.configuration.serialization.ConfigurationSerializable, ConfigurationSerialization, DelegateDeserialization, ...], [org.bukkit.conversations.Conversable, ConversationCanceller, Prompt, ...], [org.bukkit.craftbukkit.Main], [org.bukkit.craftbukkit.libs.com.google.gson.JsonDeserializer, JsonParseException, GsonBuilder, ...], [org.bukkit.craftbukkit.libs.com.google.gson.annotations.SerializedName], [org.bukkit.craftbukkit.libs.com.google.gson.internal.Excluder, $Gson$Preconditions, $Gson$Types, ...], [org.bukkit.craftbukkit.libs.com.google.gson.internal.bind.JsonTreeReader, JsonTreeWriter, TypeAdapters, ...], [org.bukkit.craftbukkit.libs.com.google.gson.reflect.TypeToken], [org.bukkit.craftbukkit.libs.com.google.gson.stream.JsonReader, JsonWriter, MalformedJsonException, ...], [org.bukkit.craftbukkit.libs.jline.Terminal, TerminalSupport, UnsupportedTerminal, ...], [org.bukkit.craftbukkit.libs.jline.console.ConsoleReader, CursorBuffer, ConsoleKeys, ...], [org.bukkit.craftbukkit.libs.jline.console.completer.CompletionHandler, CandidateListCompletionHandler], [org.bukkit.craftbukkit.libs.jline.console.history.History, MemoryHistory], [org.bukkit.craftbukkit.libs.jline.internal.InputStreamReader, Configuration, Log], [org.bukkit.craftbukkit.v1_6_R1.LoggerOutputStream, CraftServer, CraftOfflinePlayer, ...], [org.bukkit.craftbukkit.v1_6_R1.block.CraftBlock, CraftBlockState, CraftSign, ...], [org.bukkit.craftbukkit.v1_6_R1.chunkio.ChunkIOExecutor, ChunkIOProvider, QueuedChunk], [org.bukkit.craftbukkit.v1_6_R1.command.ServerCommandSender, CraftConsoleCommandSender, ColouredConsoleSender, ...], [org.bukkit.craftbukkit.v1_6_R1.conversations.ConversationTracker], [org.bukkit.craftbukkit.v1_6_R1.enchantments.CraftEnchantment], [org.bukkit.craftbukkit.v1_6_R1.entity.CraftEntity, CraftLivingEntity, CraftHumanEntity, ...], [org.bukkit.craftbukkit.v1_6_R1.event.CraftEventFactory], [org.bukkit.craftbukkit.v1_6_R1.generator.InternalChunkGenerator, CustomChunkGenerator, NormalChunkGenerator, ...], [org.bukkit.craftbukkit.v1_6_R1.help.SimpleHelpMap, CommandAliasHelpTopic, HelpYamlReader, ...], [org.bukkit.craftbukkit.v1_6_R1.inventory.CraftItemStack, CraftRecipe, CraftShapedRecipe, ...], [org.bukkit.craftbukkit.v1_6_R1.metadata.EntityMetadataStore, PlayerMetadataStore, WorldMetadataStore, ...], [org.bukkit.craftbukkit.v1_6_R1.potion.CraftPotionEffectType, CraftPotionBrewer], [org.bukkit.craftbukkit.v1_6_R1.scheduler.CraftScheduler, CraftTask, CraftAsyncTask, ...], [org.bukkit.craftbukkit.v1_6_R1.scoreboard.CraftScoreboardManager, CraftScoreboard, CraftScoreboardTranslations, ...], [org.bukkit.craftbukkit.v1_6_R1.updater.AutoUpdater, BukkitDLUpdaterService, DateDeserializer, ...], [org.bukkit.craftbukkit.v1_6_R1.util.ServerShutdownThread, Waitable, TerminalConsoleHandler, ...], [org.bukkit.enchantments.Enchantment, EnchantmentWrapper], [org.bukkit.entity.Entity, Damageable, LivingEntity, ...], [org.bukkit.entity.minecart.PoweredMinecart, StorageMinecart, ExplosiveMinecart, ...], [org.bukkit.event.Event, Cancellable, Listener, ...], [org.bukkit.event.block.BlockEvent, BlockFadeEvent, BlockGrowEvent, ...], [org.bukkit.event.enchantment.EnchantItemEvent, PrepareItemEnchantEvent], [org.bukkit.event.entity.EntityEvent, EntityInteractEvent, EntityDamageEvent, ...], [org.bukkit.event.hanging.HangingEvent, HangingPlaceEvent, HangingBreakEvent, ...], [org.bukkit.event.inventory.InventoryMoveItemEvent, InventoryEvent, PrepareItemCraftEvent, ...], [org.bukkit.event.painting.PaintingEvent, PaintingPlaceEvent, PaintingBreakEvent, ...], [org.bukkit.event.player.PlayerEvent, PlayerFishEvent, PlayerJoinEvent, ...], [org.bukkit.event.server.ServerEvent, MapInitializeEvent, ServerCommandEvent, ...], [org.bukkit.event.vehicle.VehicleEvent, VehicleCollisionEvent, VehicleBlockCollisionEvent, ...], [org.bukkit.event.weather.WeatherEvent, ThunderChangeEvent, WeatherChangeEvent, ...], [org.bukkit.event.world.WorldEvent, WorldInitEvent, WorldSaveEvent, ...], [org.bukkit.generator.ChunkGenerator], [org.bukkit.help.HelpMap, HelpTopic, IndexHelpTopic, ...], [org.bukkit.inventory.ItemStack, Inventory, Recipe, ...], [org.bukkit.inventory.meta.ItemMeta, Repairable, BookMeta, ...], [org.bukkit.map.MapView, MapFont, MinecraftFont, ...], [org.bukkit.material.MaterialData, Tree, Directional, ...], [org.bukkit.metadata.Metadatable, MetadataStore, MetadataStoreBase], [org.bukkit.permissions.ServerOperator, Permissible, PermissionDefault, ...], [org.bukkit.plugin.ServicesManager, PluginManager, SimpleServicesManager, ...], [org.bukkit.plugin.java.JavaPluginLoader, PluginClassLoader, JavaPlugin], [org.bukkit.plugin.messaging.PluginMessageRecipient, Messenger, StandardMessenger, ...], [org.bukkit.potion.PotionEffectType, PotionEffectTypeWrapper, PotionBrewer, ...], [org.bukkit.scheduler.BukkitScheduler, BukkitTask, BukkitWorker], [org.bukkit.scoreboard.ScoreboardManager, DisplaySlot, Scoreboard, ...], [org.bukkit.util.Vector, BlockVector, Java15Compat, ...], [org.bukkit.util.permissions.DefaultPermissions, CommandPermissions, BroadcastPermissions], [org.fusesource.jansi.Ansi, NoAnsi, Attribute, ...], [org.json.simple.JSONAware, JSONStreamAware, JSONObject, ...], [org.json.simple.parser.ParseException, JSONParser, Yylex, ...], [org.sqlite.JDBC, Conn, SQLiteConfig, ...], [org.yaml.snakeyaml.DumperOptions, ScalarStyle, FlowStyle, ...], [org.yaml.snakeyaml.composer.Composer, ComposerException], [org.yaml.snakeyaml.constructor.BaseConstructor, SafeConstructor, Constructor, ...], [org.yaml.snakeyaml.emitter.Emitable, Emitter, EmitterState, ...], [org.yaml.snakeyaml.error.YAMLException, MarkedYAMLException, Mark], [org.yaml.snakeyaml.events.Event, NodeEvent, ScalarEvent, ...], [org.yaml.snakeyaml.external.com.google.gdata.util.common.base.Escaper, UnicodeEscaper, PercentEscaper], [org.yaml.snakeyaml.introspector.PropertyUtils, BeanAccess, Property, ...], [org.yaml.snakeyaml.nodes.Node, CollectionNode, MappingNode, ...], [org.yaml.snakeyaml.parser.Parser, ParserImpl, Production, ...], [org.yaml.snakeyaml.reader.UnicodeReader, StreamReader, ReaderException], [org.yaml.snakeyaml.representer.BaseRepresenter, SafeRepresenter, Representer, ...], [org.yaml.snakeyaml.resolver.Resolver, ResolverTuple], [org.yaml.snakeyaml.scanner.Scanner, ScannerImpl, ScannerException, ...], [org.yaml.snakeyaml.serializer.Serializer, SerializerException], [org.yaml.snakeyaml.tokens.Token, AliasToken, ScalarToken, ...], [org.yaml.snakeyaml.util.UriEncoder, ArrayStack] IntCache: cache: 0, tcache: 0, allocated: 1, tallocated: 63 CraftBukkit Information: Running: CraftBukkit version git-Bukkit-1.5.2-R1.0-2-ga359c7f-b2794jnks (MC: 1.6.1) (Implementing API version 1.6.1-R0.1-SNAPSHOT) true Plugins: { WorldBorder v1.7.2 com.wimbli.WorldBorder.WorldBorder [Brettflan], WorldEdit v5.5.7 com.sk89q.worldedit.bukkit.WorldEditPlugin [], BukkitCompat vR22A com.mcmyadmin.bukkitcompat.BukkitCompat [PhonicUK], BattleTracker v2.5.3.7.1 mc.alk.tracker.Tracker [alkarin], SwearFilter v1.0 me.FibreGuy.MainClass [], mcore v6.4.2 com.massivecraft.mcore.MCore [Cayorion], VoteMe v3.0 me.RobTheBig.VoteMe.VoteMe [], War v1.8-PREVIEW (Nimitz) com.tommytony.war.War [tommytony], Vault v1.2.25-b320 net.milkbowl.vault.Vault [cereal, Sleaker, mung3r], PlayerHeads v3.2-jenkins-PlayerHeads-1-11-gb37e970 org.shininet.bukkit.playerheads.PlayerHeads [meiskam, zand], PermissionsEx v1.19.5 ru.tehkode.permissions.bukkit.PermissionsEx [t3hk0d3], PlotMe v0.13b com.worldcretornica.plotme.PlotMe [ZachBora], Multiverse-Core v2.4-b527 com.onarandombox.MultiverseCore.MultiverseCore [Rigby, fernferret, lithium3141, main--], HealthBar v1.6 com.gmail.filoghost.healthbar.Main [filoghost], TPCoords v1.2 me.thebutlah.tpcoords.TPCoords [], WorldGuard v5.7.3 com.sk89q.worldguard.bukkit.WorldGuardPlugin [], PwingArmory v0.0.2 me.Cronos79.PwingArmory.PwingArmory [Cronos79, Tara81], SurvivalGames v0.5.8.42 org.mcsg.survivalgames.SurvivalGames [Double0negative], Announcer v1.3.4 me.declanmc96.Announcer.announcer [declanmc96], ItemRenamer v1.0.6 net.bukkit.faris.itemrenamer.ItemRenamer [KingFaris10], TreasureChest v8.4.1 com.mtihc.minecraft.treasurechest.v8.plugin.TreasureChestPlugin [Mtihc], CapsLock v1.0.3 net.mysticrealms.fireworks.capslock.CapsLock [Fireworks], Modifyworld v1.19.4 ru.tehkode.modifyworld.bukkit.Modifyworld [t3hk0d3], Votifier v1.9 com.vexsoftware.votifier.Votifier [blakeman8192, Kramer], Essentials v2.10.1 com.earth2me.essentials.Essentials [Zenexer, ementalo, Aelux, Brettflan, KimKandor, snowleo, ceulemans, Xeology, KHobbits, md_5, Iaccidentally], EssentialsProtect v2.10.1 com.earth2me.essentials.protect.EssentialsProtect [Zenexer, ementalo, Aelux, Brettflan, KimKandor, snowleo, ceulemans, Xeology, KHobbits], EssentialsSpawn v2.10.1 com.earth2me.essentials.spawn.EssentialsSpawn [Zenexer, ementalo, Aelux, Brettflan, KimKandor, snowleo, ceulemans, Xeology, KHobbits], Multiverse-Portals v2.4-b548 com.onarandombox.MultiversePortals.MultiversePortals [Rigby, fernferret], Multiverse-Inventories v2.5-b335 com.onarandombox.multiverseinventories.MultiverseInventories [dumptruckman], Enjin Minecraft Plugin v2.4.5-bukkit com.enjin.officialplugin.EnjinMinecraftPlugin [www.Enjin.com], EssentialsChat v2.10.1 com.earth2me.essentials.chat.EssentialsChat [Zenexer, ementalo, Aelux, Brettflan, KimKandor, snowleo, ceulemans, Xeology, KHobbits, md_5, Okamosy, Iaccidentally], Factions v2.0.2 com.massivecraft.factions.Factions [Cayorion, Brettflan],} Warnings: DEFAULT Threads: { TIMED_WAITING com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1: [java.lang.Object.wait(Native Method), com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)], RUNNABLE Thread-12: [java.net.PlainSocketImpl.socketAccept(Native Method), java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398), java.net.ServerSocket.implAccept(ServerSocket.java:522), java.net.ServerSocket.accept(ServerSocket.java:490), com.vexsoftware.votifier.net.VoteReceiver.run(VoteReceiver.java:114)], TIMED_WAITING com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0: [java.lang.Object.wait(Native Method), com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)], TIMED_WAITING Connection #2290 write thread: [java.lang.Thread.sleep(Native Method), net.minecraft.server.v1_6_R1.NetworkWriterThread.run(NetworkWriterThread.java:38)], TIMED_WAITING Connection #2602 write thread: [java.lang.Thread.sleep(Native Method), net.minecraft.server.v1_6_R1.NetworkWriterThread.run(NetworkWriterThread.java:38)], TIMED_WAITING Timer-0: [java.lang.Object.wait(Native Method), java.util.TimerThread.mainLoop(Timer.java:552), java.util.TimerThread.run(Timer.java:505)], WAITING Finalizer: [java.lang.Object.wait(Native Method), java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135), java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151), java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:177)], TIMED_WAITING Thread-4: [java.lang.Thread.sleep(Native Method), net.minecraft.server.v1_6_R1.ThreadSleepForever.run(SourceFile:64)], RUNNABLE Thread-5: [java.io.FileInputStream.readBytes(Native Method), java.io.FileInputStream.read(FileInputStream.java:242), java.io.BufferedInputStream.fill(BufferedInputStream.java:235), java.io.BufferedInputStream.read(BufferedInputStream.java:254), java.io.FilterInputStream.read(FilterInputStream.java:83), org.bukkit.craftbukkit.libs.jline.console.ConsoleReader$1.read(ConsoleReader.java:167), org.bukkit.craftbukkit.libs.jline.internal.InputStreamReader.read(InputStreamReader.java:267), org.bukkit.craftbukkit.libs.jline.internal.InputStreamReader.read(InputStreamReader.java:204), org.bukkit.craftbukkit.libs.jline.console.ConsoleReader.readCharacter(ConsoleReader.java:995), org.bukkit.craftbukkit.libs.jline.console.ConsoleReader.readLineSimple(ConsoleReader.java:1506), org.bukkit.craftbukkit.libs.jline.console.ConsoleReader.readLine(ConsoleReader.java:1153), org.bukkit.craftbukkit.libs.jline.console.ConsoleReader.readLine(ConsoleReader.java:1117), org.bukkit.craftbukkit.libs.jline.console.ConsoleReader.readLine(ConsoleReader.java:1105), net.minecraft.server.v1_6_R1.ThreadCommandReader.run(ThreadCommandReader.java:33)], TIMED_WAITING pool-1-thread-759: [sun.misc.Unsafe.park(Native Method), java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226), java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460), java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359), java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942), java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043), java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103), java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603), java.lang.Thread.run(Thread.java:722)], WAITING MV-Inv Profile Write Thread: [sun.misc.Unsafe.park(Native Method), java.util.concurrent.locks.LockSupport.park(LockSupport.java:186), java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043), java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442), com.onarandombox.multiverseinventories.util.data.FlatFilePlayerData$FileWriteThread.run(FlatFilePlayerData.java:208)], WAITING Chunk I/O Executor Thread-1: [sun.misc.Unsafe.park(Native Method), java.util.concurrent.locks.LockSupport.park(LockSupport.java:186), java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043), java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442), java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043), java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103), java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603), java.lang.Thread.run(Thread.java:722)], WAITING Reference Handler: [java.lang.Object.wait(Native Method), java.lang.Object.wait(Object.java:503), java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)], RUNNABLE Server thread: [java.lang.Thread.dumpThreads(Native Method), java.lang.Thread.getAllStackTraces(Thread.java:1618), org.bukkit.craftbukkit.v1_6_R1.CraftCrashReport.call(CraftCrashReport.java:28), net.minecraft.server.v1_6_R1.CrashReportSystemDetails.a(SourceFile:74), net.minecraft.server.v1_6_R1.CrashReport.h(CrashReport.java:41), net.minecraft.server.v1_6_R1.CrashReport.<init>(CrashReport.java:28), net.minecraft.server.v1_6_R1.CrashReport.a(CrashReport.java:212), net.minecraft.server.v1_6_R1.World.tickEntities(World.java:1225), net.minecraft.server.v1_6_R1.WorldServer.tickEntities(WorldServer.java:480), net.minecraft.server.v1_6_R1.MinecraftServer.t(MinecraftServer.java:573), net.minecraft.server.v1_6_R1.DedicatedServer.t(DedicatedServer.java:226), net.minecraft.server.v1_6_R1.MinecraftServer.s(MinecraftServer.java:487), net.minecraft.server.v1_6_R1.MinecraftServer.run(MinecraftServer.java:420), net.minecraft.server.v1_6_R1.ThreadServerApplication.run(SourceFile:582)], RUNNABLE Connection #2612 write thread: [net.minecraft.v1_6_R1.org.bouncycastle.crypto.engines.AESFastEngine.processBlock(Unknown Source), net.minecraft.v1_6_R1.org.bouncycastle.crypto.modes.CFBBlockCipher.encryptBlock(Unknown Source), net.minecraft.v1_6_R1.org.bouncycastle.crypto.modes.CFBBlockCipher.processBlock(Unknown Source), net.minecraft.v1_6_R1.org.bouncycastle.crypto.BufferedBlockCipher.processBytes(Unknown Source), net.minecraft.v1_6_R1.org.bouncycastle.crypto.io.CipherOutputStream.write(Unknown Source), java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82), java.io.BufferedOutputStream.write(BufferedOutputStream.java:121), java.io.DataOutputStream.write(DataOutputStream.java:107), net.minecraft.server.v1_6_R1.Packet56MapChunkBulk.a(Packet56MapChunkBulk.java:157), net.minecraft.server.v1_6_R1.Packet.a(Packet.java:138), net.minecraft.server.v1_6_R1.NetworkManager.h(NetworkManager.java:101), net.minecraft.server.v1_6_R1.NetworkManager.d(NetworkManager.java:351), net.minecraft.server.v1_6_R1.NetworkWriterThread.run(NetworkWriterThread.java:21)], TIMED_WAITING Connection #2418 write thread: [java.lang.Thread.sleep(Native Method), net.minecraft.server.v1_6_R1.NetworkWriterThread.run(NetworkWriterThread.java:38)], RUNNABLE Listen thread: [java.net.PlainSocketImpl.socketAccept(Native Method), java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398), java.net.ServerSocket.implAccept(ServerSocket.java:522), java.net.ServerSocket.accept(ServerSocket.java:490), net.minecraft.server.v1_6_R1.DedicatedServerConnectionThread.run(DedicatedServerConnectionThread.java:59)], TIMED_WAITING com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2: [java.lang.Object.wait(Native Method), com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)], RUNNABLE Connection #2596 read thread: [java.net.SocketInputStream.socketRead0(Native Method), java.net.SocketInputStream.read(SocketInputStream.java:150), java.net.SocketInputStream.read(SocketInputStream.java:121), java.io.FilterInputStream.read(FilterInputStream.java:133), net.minecraft.v1_6_R1.org.bouncycastle.crypto.io.CipherInputStream.nextChunk(Unknown Source), net.minecraft.v1_6_R1.org.bouncycastle.crypto.io.CipherInputStream.read(Unknown Source), java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288), net.minecraft.server.v1_6_R1.Packet.a(Packet.java:96), net.minecraft.server.v1_6_R1.NetworkManager.i(NetworkManager.java:193), net.minecraft.server.v1_6_R1.NetworkManager.c(NetworkManager.java:347), net.minecraft.server.v1_6_R1.NetworkReaderThread.run(SourceFile:93)], RUNNABLE Connection #2602 read thread: [java.net.SocketInputStream.socketRead0(Native Method), java.net.SocketInputStream.read(SocketInputStream.java:150), java.net.SocketInputStream.read(SocketInputStream.java:121), java.io.FilterInputStream.read(FilterInputStream.java:133), net.minecraft.v1_6_R1.org.bouncycastle.crypto.io.CipherInputStream.nextChunk(Unknown Source), net.minecraft.v1_6_R1.org.bouncycastle.crypto.io.CipherInputStream.read(Unknown Source), java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288), net.minecraft.server.v1_6_R1.Packet.a(Packet.java:96), net.minecraft.server.v1_6_R1.NetworkManager.i(NetworkManager.java:193), net.minecraft.server.v1_6_R1.NetworkManager.c(NetworkManager.java:347), net.minecraft.server.v1_6_R1.NetworkReaderThread.run(SourceFile:93)], RUNNABLE Signal Dispatcher: [], RUNNABLE DestroyJavaVM: [], TIMED_WAITING Snooper Timer: [java.lang.Object.wait(Native Method), java.util.TimerThread.mainLoop(Timer.java:552), java.util.TimerThread.run(Timer.java:505)], TIMED_WAITING pool-1-thread-752: [sun.misc.Unsafe.park(Native Method), java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226), java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460), java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359), java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942), java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043), java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103), java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603), java.lang.Thread.run(Thread.java:722)], RUNNABLE Connection #2612 read thread: [java.net.SocketInputStream.socketRead0(Native Method), java.net.SocketInputStream.read(SocketInputStream.java:150), java.net.SocketInputStream.read(SocketInputStream.java:121), java.io.FilterInputStream.read(FilterInputStream.java:133), net.minecraft.v1_6_R1.org.bouncycastle.crypto.io.CipherInputStream.nextChunk(Unknown Source), net.minecraft.v1_6_R1.org.bouncycastle.crypto.io.CipherInputStream.read(Unknown Source), java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288), net.minecraft.server.v1_6_R1.Packet.a(Packet.java:96), net.minecraft.server.v1_6_R1.NetworkManager.i(NetworkManager.java:193), net.minecraft.server.v1_6_R1.NetworkManager.c(NetworkManager.java:347), net.minecraft.server.v1_6_R1.NetworkReaderThread.run(SourceFile:93)], TIMED_WAITING Connection #2448 write thread: [java.lang.Thread.sleep(Native Method), net.minecraft.server.v1_6_R1.NetworkWriterThread.run(NetworkWriterThread.java:38)], RUNNABLE Connection #2448 read thread: [java.net.SocketInputStream.socketRead0(Native Method), java.net.SocketInputStream.read(SocketInputStream.java:150), java.net.SocketInputStream.read(SocketInputStream.java:121), java.io.FilterInputStream.read(FilterInputStream.java:133), net.minecraft.v1_6_R1.org.bouncycastle.crypto.io.CipherInputStream.nextChunk(Unknown Source), net.minecraft.v1_6_R1.org.bouncycastle.crypto.io.CipherInputStream.read(Unknown Source), java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288), net.minecraft.server.v1_6_R1.Packet.a(Packet.java:96), net.minecraft.server.v1_6_R1.NetworkManager.i(NetworkManager.java:193), net.minecraft.server.v1_6_R1.NetworkManager.c(NetworkManager.java:347), net.minecraft.server.v1_6_R1.NetworkReaderThread.run(SourceFile:93)], WAITING PermissionsEx-Cleaner: [java.lang.Object.wait(Native Method), java.lang.Object.wait(Object.java:503), java.util.TimerThread.mainLoop(Timer.java:526), java.util.TimerThread.run(Timer.java:505)], RUNNABLE Connection #2290 read thread: [java.net.SocketInputStream.socketRead0(Native Method), java.net.SocketInputStream.read(SocketInputStream.java:150), java.net.SocketInputStream.read(SocketInputStream.java:121), java.io.FilterInputStream.read(FilterInputStream.java:133), net.minecraft.v1_6_R1.org.bouncycastle.crypto.io.CipherInputStream.nextChunk(Unknown Source), net.minecraft.v1_6_R1.org.bouncycastle.crypto.io.CipherInputStream.read(Unknown Source), java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288), net.minecraft.server.v1_6_R1.Packet.a(Packet.java:96), net.minecraft.server.v1_6_R1.NetworkManager.i(NetworkManager.java:193), net.minecraft.server.v1_6_R1.NetworkManager.c(NetworkManager.java:347), net.minecraft.server.v1_6_R1.NetworkReaderThread.run(SourceFile:93)], TIMED_WAITING MStore ExamineThread: [java.lang.Thread.sleep(Native Method), com.massivecraft.mcore.store.ExamineThread.run(ExamineThread.java:55)], RUNNABLE Connection #2418 read thread: [java.net.SocketInputStream.socketRead0(Native Method), java.net.SocketInputStream.read(SocketInputStream.java:150), java.net.SocketInputStream.read(SocketInputStream.java:121), java.io.FilterInputStream.read(FilterInputStream.java:133), net.minecraft.v1_6_R1.org.bouncycastle.crypto.io.CipherInputStream.nextChunk(Unknown Source), net.minecraft.v1_6_R1.org.bouncycastle.crypto.io.CipherInputStream.read(Unknown Source), java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288), net.minecraft.server.v1_6_R1.Packet.a(Packet.java:96), net.minecraft.server.v1_6_R1.NetworkManager.i(NetworkManager.java:193), net.minecraft.server.v1_6_R1.NetworkManager.c(NetworkManager.java:347), net.minecraft.server.v1_6_R1.NetworkReaderThread.run(SourceFile:93)], TIMED_WAITING File IO Thread: [java.lang.Thread.sleep(Native Method), net.minecraft.server.v1_6_R1.FileIOThread.b(SourceFile:44), net.minecraft.server.v1_6_R1.FileIOThread.run(SourceFile:23), java.lang.Thread.run(Thread.java:722)], TIMED_WAITING pool-1-thread-760: [sun.misc.Unsafe.park(Native Method), java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226), java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460), java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359), java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942), java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043), java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103), java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603), java.lang.Thread.run(Thread.java:722)], TIMED_WAITING Connection #2596 write thread: [java.lang.Thread.sleep(Native Method), net.minecraft.server.v1_6_R1.NetworkWriterThread.run(NetworkWriterThread.java:38)],} Recent tasks from 1302947-1302977{Enjin Minecraft Plugin:com.enjin.officialplugin.threaded.PeriodicVoteTask@1302989,Enjin Minecraft Plugin:com.enjin.officialplugin.tpsmeter.MonitorTPS@1302989,WorldEdit:com.sk89q.worldedit.bukkit.SessionTimer@1302989,} Profiler Position: N/A (disabled) Vec3 Pool Size: ~~ERROR~~ NullPointerException: null Player Count: 6 / 40; [EntityPlayer['Sto0ge'/25425658, l='SG', x=11.35, y=62.00, z=10.74](Sto0ge at 11.345391638242058,62.0,10.742800038547719), EntityPlayer['FlamedDiamond'/26855622, l='SG', x=-3.30, y=97.17, z=64.96](FlamedDiamond at -3.3000000119209325,97.1707870772188,64.96266148772278), EntityPlayer['MinemasterZXQ'/28592368, l='wild', x=155.15, y=10.00, z=460.70](MinemasterZXQ at 155.14901584467503,10.0,460.69999998807907), EntityPlayer['tthan'/28600651, l='wild', x=-55.52, y=69.70, z=38.70](tthan at -55.52068873012064,69.7000000178814,38.699999988079064), EntityPlayer['empise_WIN'/23683765, l='wild', x=157.38, y=10.00, z=473.58](empise_WIN at 157.38440226393405,10.0,473.58445274915766), EntityPlayer['BigMike65'/28621871, l='spawn', x=-1819.72, y=63.00, z=-1800.48](BigMike65 at -1819.724397379612,63.0,-1800.4823723305442)] Is Modded: Definitely; Server brand changed to 'craftbukkit' Type: Dedicated Server (map_server.txt)

Access an abstract-chunk-store over any stream

store byte streams as deduplicated, encrypted and content-addressable chunks in a memory-mapped database

Read an abstract-chunk-store as a stream

DAta CHUnks: utils to work/stream/store bytes data chunks

CodeLens: Production-grade FastAPI + React GPT Action delivering AI-powered code reviews via GitHub API integration, GPT-4o-mini structured analysis with token-aware chunking, Redis-backed caching, SSE streaming, PostgreSQL persistence, Prometheus observability, and a complete OpenAPI 3.1 schema for ChatGPT GPT Store deployment.

Filevo is an open-source peer-to-peer file sharing platform built with Python and React. Files are split into chunks in the browser, streamed through a FastAPI relay server, and automatically reassembled on the receiver's end — no signups, no file size caps, no data stored on the server.

Offline audio stream recorder — chunks stored in IndexedDB, uploaded with retry backoff

Very minimal Langchain - DeCoupled - Production Grade Tools - Realtime Streaming - AutoPDF Chunking - Vector Store

Lesson 14 - Readable Streams - Streams of data a chunk at a time, 1 chunk per buffer, allows for faster data manipulation before the full file is stored in memory.

A script which allows the live streaming of random pre-processed and chunked vods stored in S3.

A distributed video streaming backend. The video is split into fixed sizedd chunks and each chunk is assigned to a chunk server. This mapping is stored on a master server that maintains metadata.

This repository contains the ARM Template to ingest Live RTMP stream and store video chunk in Azure Storage

Lesson 13 - Streams and Buffers - Streams of data chunks stored in temporary buffers allows data to be consumed before it's fully downloaded into memory which accelerates application performance.

MpSoft.StreamCaching is caching stream supporting ahead reading. That allows to continue reading (and temporary storing) data from source (e.g. network) while processing already read chunk.

Golang Backend Service to handle uploading object of different size and type, enable chunking into postgres database, and a minio object storage instance. Later, user can list out the different file being stored, and download it as a streamed chunks.

A RAG chatbot for PDFs: users upload files, which are chunked, embedded with OpenAI, and stored in Supabase (pgvector). Queries trigger similarity search (top-k), relevant chunks are composed into prompts, and the LLM streams answers with sources. Built with Next.js, React, and LangGraph.

Goal: Build and test the performance of a BitTorrent streaming client that implement a basic Zipf-based chunk exchange policy (e.g., “Peer-assisted On-demand Streaming of Stored Media using BitTorrent-like Protocols”, Carlsson and Eager, in Proc. of IFIP Networking 2007).

An industry-grade, local-first AI platform for secure document analysis. Built with Flask, LangChain, and Ollama (Llama 3.2), it enables semantic search across massive PDF libraries using a persistent ChromaDB vector store. Features recursive chunking and streaming responses for 100% private, zero-cost UX.

Mixed the idea of Data engineering concept and AI engineering concept to work on realtime data from Wikipedia where Wikimedia Stream → Producer Service → Kafka Topic → Processor Service(involves text embedder for vector chunks) → Vector DB store adapter (Redis/FAISS) → LLM adapter (Ollama/google/flan-t5-small)

DocuMind (Insight Garden) is a document RAG (Retrieval-Augmented Generation) app: you upload PDFs, they’re chunked and embedded into a vector store (PostgreSQL + pgvector), and you chat with your documents. Answers are grounded in your docs and can stream token-by-token (e.g. via Ollama). It’s built as a Vite + React frontend and a NestJS backend,