Generators to read large Files In Python #Python #CodeSnippet #PythonTips #BigData #FileHandling #Generators #MemoryEfficient #LearnPython #PythonDeveloper #CodingTips
Recent searches
Search options
#generators
1 post1 participant0 posts today
New Kitten update
• 
Kitten HTML templates and kitten.Component render functions can now be async.
This is quite a big one and it took me finally biting the bullet and getting my head around generators in JavaScript to implement properly.
So now you can mix synchronous and asynchronous components as you like and if there are any asynchronous components in your templates they will automatically be awaited (even if you forget to use await) ;)
I’ll write a proper post/tutorial/documentation for it soon but for the time being enjoy the screenshots where a layout template gets the latest three posts from my mock fediverse public timeline service and displays them on the page.
The kitten.Component version also has a refresh button that streams a different three to the page.
For those of you unfamiliar with Kitten, this is all the code in either example. No scaffolding, nothing. Pop either into a file called index.page.js and run kitten in that folder and visit https://localhost to see the example run.
Enjoy!
![const BasicLayoutTemplate = async ({ title, SLOT }) => {
const posts = (await (await fetch('https://streamiverse.small-web.org/public/')).json()).splice(0, 3)
return kitten.html`
<main>
<page css>
<h1>${title}</h1>
${SLOT}
<h2>Fediverse posts</h2>
<ul>
${posts.map(post => kitten.html`
<li><img src='${post.account.avatar}'> ${[post.content]}</li>
`)}
</ul>
<style>
li { display: flex; gap: 1em; margin-bottom: 1em; }
img { width: 5em; height: auto; }
</style>
</main>
`
}
export default async () => await kitten.html`
<${BasicLayoutTemplate} title='Async components are fun!'>
<markdown>
Oh, isn’t this __nice?__
</markdown>
</>
`](https://s3-eu-central-1.amazonaws.com/mastodon-aral/media_attachments/files/114/258/812/670/834/838/original/228733ad125b57f4.png "const BasicLayoutTemplate = async ({ title, SLOT }) => {
const posts = (await (await fetch('https://streamiverse.small-web.org/public/')).json()).splice(0, 3)
return kitten.html`
<main>
<page css>
<h1>${title}</h1>
${SLOT}
<h2>Fediverse posts</h2>
<ul>
${posts.map(post => kitten.html`
<li><img src='${post.account.avatar}'> ${[post.content]}</li>
`)}
</ul>
<style>
li { display: flex; gap: 1em; margin-bottom: 1em; }
img { width: 5em; height: auto; }
</style>
</main>
`
}
export default async () => await kitten.html`
<${BasicLayoutTemplate} title='Async components are fun!'>
<markdown>
Oh, isn’t this __nice?__
</markdown>
</>
`")
![class BasicLayoutTemplate extends kitten.Component {
async html ({title, SLOT}) {
return kitten.html`
<main id='page' morph>
<page css>
<h1>${title}</h1>
${SLOT}
<${FediversePosts.connectedTo(this)} />
</main>
`
}
}
class FediversePosts extends kitten.Component {
async html () {
const posts = (await (await fetch('https://streamiverse.small-web.org/public/')).json()).splice(Math.floor(Math.random()*6), 3)
return kitten.html`
<div id='posts' morph>
<h2>Fediverse posts</h2>
<ul>
${posts.map(post => kitten.html`
<li><img src='${post.account.avatar}'> ${[post.content]}</li>
`)}
</ul>
<button name='refresh' connect>Refresh</button>
<style>
li { display: flex; gap: 1em; margin-bottom: 1em; }
img { width: 5em; height: auto; }
</style>
</div>
`
}
onRefresh () { this.update() }
}
export default class MyPage extends kitten.Page {
async html () {
return kitten.html`
<${BasicLayoutTemplate.connectedTo(this)} title='Async components are fun!'>
<markdown>
Oh, isn’t this __nice?__
</markdown>
</>
`
}
}](https://s3-eu-central-1.amazonaws.com/mastodon-aral/media_attachments/files/114/258/813/076/463/648/original/22f714259e01b4f8.png "class BasicLayoutTemplate extends kitten.Component {
async html ({title, SLOT}) {
return kitten.html`
<main id='page' morph>
<page css>
<h1>${title}</h1>
${SLOT}
<${FediversePosts.connectedTo(this)} />
</main>
`
}
}
class FediversePosts extends kitten.Component {
async html () {
const posts = (await (await fetch('https://streamiverse.small-web.org/public/')).json()).splice(Math.floor(Math.random()*6), 3)
return kitten.html`
<div id='posts' morph>
<h2>Fediverse posts</h2>
<ul>
${posts.map(post => kitten.html`
<li><img src='${post.account.avatar}'> ${[post.content]}</li>
`)}
</ul>
<button name='refresh' connect>Refresh</button>
<style>
li { display: flex; gap: 1em; margin-bottom: 1em; }
img { width: 5em; height: auto; }
</style>
</div>
`
}
onRefresh () { this.update() }
}
export default class MyPage extends kitten.Page {
async html () {
return kitten.html`
<${BasicLayoutTemplate.connectedTo(this)} title='Async components are fun!'>
<markdown>
Oh, isn’t this __nice?__
</markdown>
</>
`
}
}")
"Generators" are a powerful tool in PHP when working with large or streamed datasets. They help improve memory efficiency, performance, and scalability, making them a great alternative to traditional array-based processing.
Do you already use generators in your projects?
DEV CommunityEfficiently handle large datasets, huge files and data streams with PHP generatorsHandling large files (for example, CSV/text files) or HTTP data streams in PHP can be challenging,...
FLOWBLADE Generators are Media Items that render into animated media clips when placed on timeline.
Currently there are three different types of Generators.
1. Backgrounds Generators are animated backgrounds.
2. Texts Generators are animated texts.
3. Cover Transitions Generators are incoming shapes that cover the frame fully and then disappear creating a transition.
Flowblade Generators are implemented as Python scripts using Fluxity API.
Dive into the world of creative text generators with Perchance! 
Whether you're crafting stories, building games, or just having fun, Perchance lets you create your own generators with ease. Sign up is simple, and they only email you when you ask. 
Get started now! 
https://perchance.org/welcome #textgenerator #creativecoding #generators #perchance
perchance.orgCreate a Random Generator
I've been using Nikola - https://getnikola.com/ for my two blogs for the last few years, and I'm finding the mechanics cumbersome.
I thought it was just a matter of acclamating, but it's not. It's been quite a while and quite a number of posts, and it's not getting any easier.
My needs are so minimal, I'm thinking I should maybe look into moving to another static site generator.
Hugo is what all the cool kids are using, but when I look at it I get intimidated by the whole go module based theme thing and ... Uck. I just need something utterly DUMB ASS simple.
Does anyone use something like this that they like? Am I over-inflating Hugo's complexity?
The truth is I was a pretty happy Wordpress user back in the day, but I was an idjit and ran my site poorly so it got knocked over by a script kiddie.
Nikola · Static Site GeneratorNikola — Static Site Generator. In goes content, out comes a website, ready to deploy.
After failed attempts in 2021 and 2023, southeast Texas lawmakers have filed bills to require generators in nursing homes and assisted living centers.
Houston Public Media · After Hurricane Beryl, Texas lawmakers push for generators at senior living facilities
Random thought for anyone who has been running a generator in Southern California over the past few days (especially you newbies):
1. CHANGE THE OIL (undoubtedly needs to be changed)
2. MAYBE CHANGE THE AIR FILTER
3. STABIL in the gas tank... just in case you don't use it again for awhile.
4. MAKE sure you run the carb dry before storing (shut of fuel supply and let it run until it shuts off by itself), so gasoline doesn't sit in your carb and gum up.
(Much better solution is natural gas/propane conversion).
Repeating this advice: if you used your generator last week to keep power to your house in Southern California, it most likely needs an oil change. Do it before Monday. They need an oil change every 100 hours. 5w30 or 10w30 depending on your model, usually. #generators #backuppower #PSPS #poweroutages
Continued thread
Carbon Monoxide Hazards
When used in a confined space, generators can produce
high levels of CO within minutes. When you use a portable
generator, remember that you cannot see or smell CO. Even if
you do not smell exhaust fumes, you may still be exposed
to CO.
Danger labels are required
on all portable generators
manufactured or imported on
or after May 14, 2007.
If you start to feel sick, dizzy, or
weak while using a generator, get to fresh air RIGHT AWAY. DO NOT DELAY. The CO from generators can rapidly kill you.
2/x
Continued thread
Portable Generator Hazards
Portable generators are useful when temporary or remote
electric power is needed, but they also can be hazardous. The
primary hazards to avoid when using a generator are carbon
monoxide (CO) poisoning from the toxic engine exhaust,
electric shock or electrocution, fire and burns.
Every year, people die in incidents related to portable generator use. Most of the incidents associated with portable generators reported to CPSC involve CO poisoning from generators used indoors or in partially-enclosed spaces.
1/x
Continued thread
CPSC Safety Alert: Portable Generator Hazards
#safety #generators #disasters
Generator safety PSA: ***DO NOT FILL UP A RUNNING GASOLINE GENERATOR***
Gasoline fumes are released when you refuel the tank, and there is a high risk of igniting those vapors from the hot exhaust of the generator. You should not only turn OFF the generator, but also WAIT FOR IT TO COOL DOWN.
(you can get devices to toggle tanks/etc. safely, but most people do not have this).
The worst time to cause yourself burn injuries (and worse yet, maybe set your neighborhood on fire) is during the middle of a disaster.
One thing that extremely frustrates me about #AI #image #generators in 2024 is that they still just absolutely cannot get something incredibly simple like #spelling right. No matter how you prompt it ("there are no spelling mistakes"), it just cannot get the only part right that it could've just copied and pasted from your text. Here's the closest I got to what I asked for, "Jason Pettus, Editor" in the middle, surrounded by the words "Chicago," "Global," "Ethical" and "Ruthless."
The Kashmere Gardens multi-service center will receive a permanent generator next year, city officials announced Wednesday. The move is one step in a plan to establish a resiliency hub in one of the city's most underserved neighborhoods.
Houston Public Media · Permanent generator to be installed in Kashmere Gardens resiliency hub next year
Continued thread
Nearly two dozen #Republican-led states [because, of course] & a handful of #power #generators asked to pause the #mercury rules, which were finalized in May, while #litigation over them continues in lower courts. The *challengers* argue that the #regulations impose heavy costs while providing negligible direct #health benefits to the public….
[As of now] #PowerPlants must comply w/the Biden regulations by July 2027.
so we were in the path of #hurricanehelene and are lucky we got by with minor damage (roof shingles, gazebo, etc.). #power is out and I'm guessing it could be quite a while before it's back.
I know they'll be largely sold out atm, but curious what folks recommend for whole house #generators ?
Particularly options that might be on the innovative side of things. I'm not a bleeding edge guy, but I do like to take advantage of stable, relatively recent innovations. :)
Demand for generators grows amid Texas outages. But who can afford them?
Houston Public Media · Demand for generators grows around Texas amid frequent outages
CPSC: CPSC Urges Those in the Path of Hurricane Francine to Take Steps to Prevent CO Poisoning and Other Post-Storm Hazards
The U.S. Consumer Product Safety Commission (CPSC) is urging those in the path of Hurricane Francine to take steps to protect themselves and their families against carbon monoxide (CO) poisoning, fires and other post-storm hazards.
Loss of Power—Using a Generator Safely
Consumers need to be especially careful when storms knock out electrical power. (more...)
U.S. Consumer Product Safety CommissionNewsroom News Releases
The majority of people who died due to Hurricane Beryl were seniors. Advocates say the death toll raises questions about what state and local leaders have done to protect the safety and comfort of elderly Texans.
Houston Public Media · Hurricane Beryl exposes gaps in storm preparation laws for Texas seniors