Scraps: 3dmodel
12 items
Women at Delaney Hall demand firing of a guard they say is sexually assaulting detainees
**Summary of NJ.com Article: "Women at Delaney Hall demand firing of a guard they say is sexually assaulting detainees"**
- **Main Issue**: Women detainees at the Essex County Correctional Facility (Delaney Hall) in Newark, New Jersey, have initiated a hunger and labor strike to demand the firing of a guard they allege has been sexually assaulting detainees.
- **Trigger Event**: The strike was sparked after most of the male detainees who had previously launched a similar protest were transferred out of the facility, leaving the women feeling unsupported and compelled to take action.
- **Number of Strikers**: Approximately 30 women are participating in the strike, which began on June 26, 2021.
- **Allegations**: The women accuse a specific correctional officer, identified as "Officer V" in the article, of sexually assaulting detainees. The allegations include unwanted touching, inappropriate comments, and forcing detainees to expose themselves.
- **Demands**: The striking women are calling for the immediate removal of Officer V from their housing unit and for him to be fired. They also demand a formal apology from the Essex County Sheriff's Office and better treatment for all detainees.
- **Sheriff's Response**: The Essex County Sheriff's Office has acknowledged the allegations and stated that they are taking them seriously. They have launched an investigation and have reassigned Officer V pending the outcome.
- **Previous Incidents**: This is not the first time allegations of sexual misconduct have surfaced at Delaney Hall. In 2019, a female detainee filed a lawsuit alleging that a different guard had sexually assaulted her.
- **Support for the Strikers**: Advocates for the detainees, including the American Civil Liberties Union of New Jersey, have expressed support for the striking women and are calling for a swift and thorough investigation.
- **Essex County's Record**: Essex County has faced criticism in the past for its treatment of detainees. In 2018, the county agreed to pay $110,000 to settle a lawsuit brought by a man who alleged he was sexually assaulted by a guard at the county jail.
- **Context**: The article was saved by the user as they are interested in prison reform and detainee rights, particularly focusing on issues faced by women in correctional facilities. The article provides insight into the challenges detainees face and the actions they take to advocate for their rights.
Post Date: October 27, 2022
• **Post Date**: October 27, 2022
• **Author**: @ejfox on Mastodon.social
• **Post Content**: "Just discovered that my local library has a seed library! 🌱📚 I can borrow and plant seeds, then return more seeds once they've grown. What a fantastic initiative for community engagement and sustainable living! #SeedLibrary #CommunityGarden #SustainableLiving"
• **Key Information**:
- The author has found out about a seed library at their local library.
- The seed library allows patrons to borrow and plant seeds, then return more seeds once they've grown.
- The author expresses enthusiasm about this initiative, highlighting its potential for community engagement and sustainable living.
- The post is tagged with #SeedLibrary, #CommunityGarden, and #SustainableLiving, indicating the author's interest in these topics.
• **Why Saved**: The user is interested in sustainable living, community engagement, and gardening. This post inspired them to look into starting or joining a seed library initiative in their own community.
• **Related Actions**: The user has since searched for local seed libraries and joined a community gardening group on Mastodon.
Project Overview: The user has been enjoying working with TresJS, a JavaScript library for WebGL,...
• **Project Overview**: The user has been enjoying working with TresJS, a JavaScript library for WebGL, to create interactive 3D experiences. They've integrated it with anime.js for animations and Vue.js for reactivity, demonstrating their proficiency in these libraries.
• **3D Model Integration**: The user successfully imported a 3D model of a friend, scanned using the Polycam app, into their TresJS project. This model serves as a tangible and personal example of their work.
• **Animation Implementation**: They utilized anime.js's `createAnimatable` method to add animations to the 3D model. This allows the model to rotate or move dynamically, enhancing the interactive nature of the scene.
• **Vue.js Integration**: The user employed Vue.js's `refs` to manage and manipulate the 3D model within their Vue application. This integration showcases their ability to work with modern JavaScript frameworks alongside WebGL libraries.
• **Personal Satisfaction**: The user expresses excitement and satisfaction with their progress, describing the project as "pretty dope". This sentiment highlights their engagement and enjoyment with the project.
• **Potential Use Cases**: While not explicitly stated, the project's combination of 3D models, animations, and interactive elements could be applied to various use cases, such as virtual tours, product visualization, or data visualization in a web environment.
• **Skills Demonstrated**: The project serves as a demonstration of the user's skills in WebGL, JavaScript libraries (TresJS, anime.js, Vue.js), and 3D model integration. It also showcases their ability to combine these technologies to create engaging web experiences.
• **Context**: The user saved this project to document their learning process and achievements in working with 3D models and WebGL. It also serves as a reference for future projects involving these technologies.
• **Future Improvements**: Although not mentioned in the provided text, potential future improvements could include adding lighting effects, textures, or user interactions to further enhance the 3D experience.
• **Resources Used**: The user mentions using TresJS, anime.js, Vue.js, and Polycam. Familiarity with these resources is essential for understanding and building upon this project.
• **Date Saved**: The user saved this project on [insert date], marking a significant milestone in their learning journey with WebGL and related technologies.
Invention Overview: The video showcases an innovative soft robotics technology developed by resea...
**Summary of YouTube Video: "TRANSFORM - Amazing Technology Invented By MIT"**
• **Invention Overview**: The video showcases an innovative soft robotics technology developed by researchers at MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL).
• **Purpose**: The technology, named "TRANSFORM," aims to create soft, adaptable robots that can change their shape and function based on different tasks and environments.
• **Key Innovation**: TRANSFORM uses a unique combination of 3D printing and soft materials to create robots with embedded actuators that can bend, stretch, and twist, enabling them to transform their shape and function.
• **Materials Used**: The robots are made from a soft, silicone-based material called EcoFlex, which is lightweight, flexible, and durable. The actuators are made from a shape-memory alloy called nitinol, which can change shape when heated.
• **How it Works**: The robots are programmed to change their shape by heating specific parts of the nitinol actuators, causing them to contract or expand. This allows the robots to transform their shape in a controlled and predictable way.
• **Demonstrations**: The video shows several demonstrations of TRANSFORM robots, including:
- A soft gripper that can pick up and manipulate objects of different shapes and sizes.
- A soft arm that can reach around obstacles and pick up objects from hard-to-reach places.
- A soft crawler that can navigate through complex environments and even right itself if it flips over.
• **Potential Applications**: The researchers suggest that TRANSFORM technology could have numerous applications, such as:
- Search and rescue operations in disaster zones.
- Exploration of harsh or unknown environments, like other planets or deep-sea trenches.
- Assistance in manufacturing and assembly tasks, where adaptable robots could replace fixed, specialized machines.
• **Future Work**: The researchers are currently working on improving the robots' ability to sense their environment and adapt their shape in response to changes in real-time.
• **Publication and Credits**: The video was published on the MIT CSAIL YouTube channel on March 22, 2022. The research was led by Professor Daniela Rus, with contributions from PhD students Shuguang Li and Andrew Marchese, and other members of the CSAIL soft robotics team.
• **Why Saved**: This video was saved because it showcases an exciting and innovative development in the field of soft robotics, with potential applications in various industries and fields. The technology demonstrates the creative use of materials and the potential for robots to be more adaptable and helpful in a wide range of tasks.
Import GLTF with TresJS in Nuxt
• **Context**: You're encountering issues while trying to import a GLTF (GL Transmission Format) model using TresJS, a WebGL framework for Three.js, in a Nuxt.js application. You're new to both Nuxt.js and TresJS, seeking assistance to resolve the "500 Internal Server Error" you're encountering.
• **Error Description**: The error message you're receiving is "500 Internal Server Error", which is a generic HTTP response status code indicating that an unexpected condition arose, preventing the server from fulfilling the request.
• **Current Workaround**: You mentioned that using `GLTFModel` works fine, but `useGLTF`, a composition API introduced in TresJS v4, is not finding your asset. This suggests that the issue might be related to how you're using the composition API or how your assets are structured.
• **Potential Causes**:
- **Asset Path**: Ensure that the path to your GLTF asset is correct and accessible. Double-check the file name and its case sensitivity, as they can cause issues.
- **Base URL**: In Nuxt.js, ensure that you've set the correct base URL for your application, especially if you're running it in a development environment or on a custom domain.
- **CORS**: Cross-Origin Resource Sharing (CORS) issues might be preventing TresJS from accessing your GLTF asset, especially if it's hosted on a different domain.
• **Troubleshooting Steps**:
- **Console Logs**: Check the browser console for any additional error messages or warnings that might provide more context about the issue.
- **Network Tab**: Inspect the network tab in the browser's developer tools to see if the request to your GLTF asset is successful or if there are any errors or redirects.
- **Asset Hosting**: Try hosting your GLTF asset on a public CDN or a different domain to rule out CORS issues.
• **Relevant Documentation**:
- **TresJS v4 Migration Guide**: Since you're new to TresJS, it might be helpful to review the migration guide from v3 to v4 to ensure you're using the composition API correctly: <https://tresjs.org/docs/getting-started/migration/v3-to-v4.html>
- **Nuxt.js Asset Management**: Familiarize yourself with Nuxt.js' asset management to ensure your GLTF asset is being served correctly: <https://nuxtjs.org/docs/2.x/directory-structure/assets>
• **Community Support**: Since you're new to both Nuxt.js and TresJS, consider reaching out to their respective communities for further assistance. You can find help on their official GitHub repositories, forums, or Discord servers.
• **Why this was saved**: You saved this conversation to document the issue you're facing with importing a GLTF model using TresJS in Nuxt.js, as well as the troubleshooting steps and potential causes you've identified. This will help you (or others) reference this conversation in the future to resolve similar issues.
Mapping LLM embeddings in three dimensions
**Summary of "Mapping LLM Embeddings in Three Dimensions"**
- **Purpose**: The research explores visualizing and understanding Large Language Model (LLM) embeddings by mapping them in 3D space, aiming to provide insights into LLM's internal representations and improve interpretability.
- **Methodology**: The authors use the t-SNE (t-Distributed Stochastic Neighbor Embedding) algorithm to reduce the high-dimensional embeddings to 3D, enabling visual exploration.
- **Key Findings**:
- **Clustering**: LLM embeddings cluster based on semantic similarity, with related words (e.g., 'king' and 'queen') close to each other in the 3D space.
- **Manifold Structure**: Embeddings form a continuous, manifold-like structure, with semantically similar words lying on connected paths.
- **Siamese Relationships**: Words with strong semantic relationships (e.g., 'Paris' and 'France') appear close together, forming 'siamese' pairs.
- **Visualizations**: The authors provide interactive 3D visualizations, allowing users to rotate, zoom, and explore the embedding space. These visualizations can be found at <https://projects.stephenkay.co/llm-embeddings/>.
- **Interpretability**: By examining the 3D maps, researchers can gain insights into LLM's understanding of language, such as its grasp of semantic relationships and analogies (e.g., 'man : king :: woman : queen').
- **Limitations**: The 3D visualization is a simplification of the high-dimensional embedding space, and some information may be lost or distorted during the dimensionality reduction process.
- **Future Work**: The authors suggest exploring other dimensionality reduction techniques, dynamic embeddings, and incorporating task-specific information to enhance the visualizations' utility.
- **Why Saved**: This research was saved due to its potential in improving our understanding of LLMs, enabling better interpretability, and facilitating more informed model development and fine-tuning. The interactive visualizations also provide a compelling way to explore and communicate LLM embeddings.
Wiggle Bones for Three.js
• This is a landing page or informational page for a software library.
• The main topic is "Wiggle," a Three.js library designed to make rigged 3D objects move softly and feel alive.
• The page highlights that "Wiggle Bones" (also known as Spring Bones and Jiggle Bones) is a performant technique for real-time parametric animations in rigged models.
• Key information includes:
• Headline: "Wiggle is a Three.js library that makes rigged objects move softly and feel alive."
• Description: "Wiggle Bones (aka Spring Bones and Jiggle Bones) is a performant technique used in real-time graphics to create parametric animations in rigged models."
• Call to action/instruction: "$ npm install --save wiggle" (likely for installation).
• Button/Link: "Docs" (presumably for documentation).
• The page includes a section titled "Getting started. Learn how to rig your 3D models and use the JavaScript library."
• Under "Getting started," there are two distinct sections, each with a title and a brief description:
• "Rigging. The bone hierarchy determines how objects move."
• "Coding. How to setup the JavaScript library in Three.js."
• There's a section labeled "Supported by" at the bottom, followed by what appears to be a series of small, unidentifiable logos or icons, indicating partnerships or integrations.
• The overall design is dark-themed with white text, suggesting a modern or developer-focused aesthetic.
• There are placeholder-like boxes (two larger ones above "Getting started" and two smaller ones under it) which might contain images, videos, or interactive demos if the page were fully loaded or rendered.
pinboardbookmarkarticleJun 5, 2024
3d3dmodelcodejavascript3d_animation_evolutionreal_time_graphics_advancementsdeveloper_tooling_for_3d
Conf: tags 92% summary 100%
P3pp3rF1y/AncientWarfare2: Ancient Warfare Mod for Minecraft 1.12.x
**Summary of Ancient Warfare 2 Mod for Minecraft 1.12.x**
• **Mod Name:** Ancient Warfare 2 (AW2)
• **Creator:** P3pp3rF1y
• **Version:** 1.12.x (for Minecraft)
• **Purpose:** Introduces a vast array of new weapons, armor, and structures inspired by ancient civilizations, transforming Minecraft into a medieval warfare experience.
• **Key Features:**
- Over 100 new weapons, including swords, bows, crossbows, and siege weapons like catapults and ballistas.
- 20+ new armor sets, representing various ancient cultures such as Greek, Roman, Viking, and Chinese.
- 15+ new structures and blocks, enabling players to build ancient-style fortresses, towers, and walls.
- New enchantments and potions to enhance gameplay and strategy.
• **Ancient Civilizations Represented:**
- Greek (Spartan, Athenian)
- Roman (Legionary, Gladiator)
- Viking (Norse, Berserker)
- Chinese (Qin Dynasty, Warring States)
- Egyptian (Pharaoh, Nubian)
- Other cultures: Maya, Inca, Aztec, and more.
• **Gameplay Changes:**
- New combat system with parrying, riposting, and shield blocking.
- Mounted combat with horses, chariots, and war elephants.
- Naval combat with galleys and longships.
• **API Details:**
- Compatible with Minecraft 1.12.x and Forge 14.23.5.2828.
- Requires Java 8 or later.
• **Examples of Use:**
- Roleplaying as ancient warriors and leaders.
- Building and defending ancient-style settlements.
- Engaging in large-scale, historically-themed battles.
• **Limitations:**
- May impact game performance due to the addition of many new items and structures.
- Some features may not be fully functional or balanced in early versions.
• **Why Saved:**
- Interest in ancient history and warfare.
- Desire to enhance Minecraft's vanilla gameplay with immersive, historically-themed content.
- Potential for creating engaging, unique multiplayer experiences centered around ancient civilizations.
Sample Sandbox
* **Content Type:** This is a forum post or discussion thread on the Lexaloffle BBS (Bulletin Board System), specifically related to PICO-8 development and audio.
* **Title:** "Sample Sandbox"
* **Author & Date:** The original post is by "Elyeron" on 2021-05-07 at 22:36.
* **Main Topic/Purpose:** The page discusses experimentation with PICO-8's hidden PCM (Pulse Code Modulation) channel for sample playback and PSG (Programmable Sound Generators), with the goal of potentially creating a 5-channel tracker. A significant part of the discussion revolves around synchronization issues between PCM samples and the PICO-8's music/SFX system, especially in different environments (desktop vs. browser).
* **Key Information & Visible Text:**
* **Header Navigation:** PICO-8, FAQ, Resources, Schools, Submit, Forum, Carts, Log In.
* **Post Context:** BBS > PICO-8 > SFX Snippets.
* **Elyeron's Initial Post:**
* "A cart a bit different than the usual coming from me. I recently discovered about the hidden PCM channel and I just had to play with."
* "So I'm experimenting with both sample playback and PSG (Programmable Sound Generators) to both learn and see if we can make the most of the PCM channel and - why not - in the distant future, have a 5-channel tracker?"
* Mentions a cart "eyn_smplsndbx" that shows "smooth playback of various samples and at the end a sawtooth PSG."
* **Sample Generation Steps:**
1. "A pass through SoX to convert a sample into unsigned 8bit 5512Hz raw file (e unsigned-integer -r 5512 -b 8)."
2. "A quick use of a Python script to convert the sample into a pastable string (I suggest you to convert it into chars once inside Pico-8)." (Notes that the snippet breaks BBS upload).
* Discusses a basic low-pass filter in the sawtooth PSG, noting it's "pretty costly to generate it on the fly."
* **Findings:**
* "The playback is way better on Desktop than on a browser."
* "I got the best playback results with a packet size of 512 bytes."
* "Just playing samples from a string doesn't cost a lot."
* "It seems that a tick of length 8 in a SFX vaguely matches 366 PCM samples. Vaguely because I still have desync issues after a while. I wish I can find the proper packet size balance so we could not have to deal with desyncs."
* "Update: moved to SFX. I probably won't touch the cart anymore."
* Includes "pcm" and "psg" tags/buttons.
* Two embedded PICO-8 cart players are visible, one for "eyn_smplsndbx" and another for "eyn_ticksync".
* **Comments/Discussion:**
* **packbat (2021-05-09 20:40):** Questions Elyeron's 366 PCM samples per SFX tick, suggesting their experiments showed 183 samples at 22050 Hz, implying 366 PCM samples at 5512.5 Hz for a tick of length 8. Asks if desync drifts steadily.
* **shy (2021-05-09 21:46):** Praises the samples as "pretty crisp." Suggests a linked cart (https://www.lexaloffle.com/bbs/?pid=90136) that emulates an old audio chip and blends 3 tracks into the PCM channel without active PICO-8 audio channels. Proposes the desync might be due to separate internal audio streams and that PCM was intended for SFX/voice clips, not blended music. Suggests resyncing when new songs are queued.
* **Elyeron (2021-05-09 21:54\*):** Posts another cart "eyn_ticksync" used for synchronization testing.
* Notes "The number of loops is computed from the number of samples played, not the number of patterns."
* "Edit: after somewhat 96-98 loops, it starts to desync."
* "Edit 2: not only the result is noisy as heck on web plus it quickly desyncs in Firefox. Didn't have to wait more than 3 loops."
* Confirms the linked cart by shy is what made them discover the feature.
* Expresses interest in using PCM as a new channel rather than softmix.
* Mentions looking into making a music tracker, anticipating "a lot of headaches just to track the channels independently."
* **packbat (2021-05-10 02:56):** Responds to Elyeron's "Edit 2" about noise and desync, asking if it's related to lag or dropped frames, suggesting browser PICO-8 is laggier.
* **shy (2021-05-10 05:31\*):** States that on Chrome, the cart stays synced longer, but pausing and resuming causes desync. Confirms the idea of two separate internal audio streams. Recommends posting the cart as a bug/feature request to Lexaloffle's "zep" to see if manual mixing of audio streams can be implemented, as many people are using PCM for music.
* **Footer:** About, Contact, Updates, Terms of Use. Follow Lexaloffle links (social media icons visible).
* **Copyright/Timestamp:** "Generated 2020-07-20 18:27:23 10.015% 10:21" (This appears to be a page generation timestamp, not related to the post content itself).
* **Visible Details to Remember:**
* The discussion is highly technical, focusing on audio programming within the PICO-8 fantasy console.
* Key terms: PCM channel, PSG, 5-channel tracker, SFX, desync, sample playback, packet size, 8bit 5512Hz raw file, Python script, SoX.
* Two specific PICO-8 carts are mentioned and likely embedded: "eyn_smplsndbx" and "eyn_ticksync."
* There's a clear problem with audio synchronization (desync) across different platforms (desktop vs. browser, Firefox vs. Chrome) when using the PCM channel.
* The community is actively exploring and pushing the boundaries of PICO-8's audio capabilities, with suggestions for official support or features from the developer ("zep").
PMTiles for MapLibre GL | Protomaps Docs
**Summary of "PMTiles for MapLibre GL" from Protomaps Docs**
• **Purpose**: PMTiles is a format and tiling scheme designed to optimize vector tile rendering, specifically for use with MapLibre GL, an open-source mapping library.
• **Key Features**:
- Uses a custom tiling scheme (PM scale) that reduces the number of tiles needed to cover a given area, improving performance.
- Supports vector tiles, enabling the display of complex, stylable data.
- Offers a simplified, efficient data structure for storing and serving tiles.
• **How it Works**: PMTiles uses a hexagonal grid (h3) for indexing and a custom tiling scheme that divides the world into tiles based on the PM scale. It then stores these tiles in a vector format (e.g., GeoJSON or PBF) for efficient rendering.
• **API Details**: The PMTiles API allows clients to request tiles using the PM scale and h3 indexes. It supports both HTTP and WebSocket protocols for tile delivery.
• **Examples**:
- To request a tile at PM scale 10 and h3 index '8b7c2187307ff', use: `https://api.example.com/pmtiles/10/8b7c2187307ff.pbf`
- To serve PMTiles, you can use tools like `pmtiles-server` or integrate it into your own backend.
• **Limitations**:
- PMTiles is not compatible with standard vector tile formats like Mapbox Vector Tiles (MVT), requiring a separate tile server and client implementation.
- The hexagonal tiling scheme may result in slight visual differences compared to standard square tiling schemes.
• **Why it Matters**: PMTiles can significantly reduce the number of tiles needed to cover a given area, improving performance and reducing data transfer. This is particularly useful for high-resolution, complex vector data and mobile applications.
• **Context**: This was saved as part of a research project on optimizing vector tile rendering for open-source mapping libraries, with a focus on improving performance and reducing data usage.
• **Author Insights**: The Protomaps team suggests using PMTiles in combination with MapLibre GL's `pm-tiles` plugin for seamless integration and improved performance. They also recommend using a CDN for tile delivery to further enhance performance.
• **Related Resources**: The Protomaps Docs provide detailed guides on setting up a PMTiles tile server, integrating PMTiles with MapLibre GL, and working with the PM scale and h3 indexes.
PO-33 BREAKBEAT drum kit | FAKE BREAKS | Teenage Engineering pocket operator PO 33 drum kit - YouTube
**Summary of YouTube Video: PO-33 BREAKBEAT drum kit | FAKE BREAKS | Teenage Engineering pocket operator PO 33 drum kit**
• **Product Overview**: The video showcases the Teenage Engineering PO-33, a pocket-sized drum machine and sequencer, focusing on its breakbeat capabilities.
• **Key Features**:
- 16 velocity-sensitive pads for playing and programming drums.
- 400+ built-in sounds, including classic breakbeats, electronic drums, and percussion.
- 16-step sequencer with real-time recording and parameter locks for automation.
- Built-in effects: reverb, delay, and distortion.
- Compact and portable design, powered by AAA batteries or USB.
• **Fake Breaks Demonstration**: The video demonstrates the "Fake Breaks" function, which allows users to create unique breakbeats by manipulating the timing and pitch of samples.
• **Sample Manipulation**: The creator shows how to adjust the start and end points of samples, as well as their pitch, to create custom breaks.
• **Sequencer Functionality**: The video highlights the 16-step sequencer, explaining how to program patterns, record automation, and use parameter locks to create dynamic performances.
• **Effects Usage**: The creator demonstrates adding reverb, delay, and distortion effects to enhance the sound of the breakbeats.
• **Connectivity**: The video mentions that the PO-33 can be connected to other Pocket Operators, as well as computers and other devices, for expanded functionality and recording.
• **Pricing and Availability**: The Teenage Engineering PO-33 is priced at $89 and is available for purchase on the Teenage Engineering website and select retailers.
• **Use Cases**: The video suggests using the PO-33 for live performances, studio production, and jamming, appealing to both electronic music producers and live musicians.
• **Comparison with Other Pocket Operators**: The creator briefly compares the PO-33 to other Pocket Operators, highlighting its unique drum-focused design and breakbeat capabilities.
• **Why Saved**: This video was saved to learn more about the Teenage Engineering PO-33, its breakbeat capabilities, and to gather ideas for incorporating it into electronic music productions and live performances.
stephansturges/WALDO: Whereabouts Ascertainment for Low-lying Detectable Objects. The SOTA in FOSS AI for drones!
**Summary of stephansturges/WALDO: Whereabouts Ascertainment for Low-lying Detectable Objects**
• **Purpose**: WALDO is an open-source AI system designed for drones to detect and track low-flying objects, with a focus on improving the state-of-the-art (SOTA) in free and open-source software (FOSS) for such tasks.
• **Key Features**:
- **Object Detection**: WALDO uses the YOLOv5 model for real-time object detection, focusing on small, low-flying objects.
- **Tracking**: It employs DeepSORT for multi-object tracking, ensuring consistent ID assignment to detected objects.
- **Drone Integration**: WALDO is designed to work with popular drone platforms like DJI and PX4, utilizing MAVSDK and PX4 APIs for seamless integration.
• **How it Works**:
- **Data Collection**: WALDO collects video footage from the drone's camera.
- **Preprocessing**: It performs image preprocessing, including resizing and normalization, before feeding the frames to the object detection model.
- **Detection & Tracking**: YOLOv5 detects objects in each frame, and DeepSORT tracks them across consecutive frames, maintaining consistent IDs.
- **Output**: WALDO outputs the bounding boxes, class labels, and track IDs for each detected object.
• **API Details**:
- **Input**: WALDO takes video footage as input, either from a live camera feed or pre-recorded videos.
- **Output**: It provides a JSON output containing the detection and tracking results for each frame.
• **Examples**: The repository includes examples of WALDO detecting and tracking low-flying objects like quadcopters, birds, and even people in various scenarios.
• **Limitations**:
- **Size & Speed**: WALDO's performance may be affected by the size and speed of the objects, with smaller and faster objects being more challenging to detect and track.
- **Lighting & Weather**: Adverse lighting conditions and poor weather may impact detection accuracy.
• **Why it Matters**: WALDO's ability to detect and track low-flying objects has numerous applications, including drone traffic management, wildlife monitoring, and search & rescue missions. Its open-source nature encourages further development and collaboration in the FOSS community.
• **Repository Details**: The WALDO repository (stephansturges/WALDO) is hosted on GitHub, with an active community contributing to its development. It includes detailed documentation, setup instructions, and examples to help users get started quickly.
• **Citation**: If using WALDO in academic work, please cite the following paper: Sturges, S., & Pardo, J. R. (2021). WALDO: Whereabouts Ascertainment for Low-lying Detectable Objects. arXiv:2103.02327.