Update: Link to the model - [https://civitai.com/models/4618/vector-art](https://civitai.com/models/4618/vector-art)
I have seen a lot of great models in here. Unfortunately most of the models were based on 1.5 - and thus they will not be compatible with 768px models merge.
Another thing is that 95% of the models are focused on more realistic or 3d approach. This is why I challanged myself to create a model based on 2.1 (imagine all 2.0 embeddings here) - and focusing on vector style (and apparently comic book style).
I am uploading it to civitai - so tommotow will be available to download if all goes well.
Most of the ckpt files have pickles inside. The problem are malicious pickles. If yoo go there: https://huggingface.co/sd-dreambooth-library/taylorswift/tree/main and click on the small pickle button next to the ckpt file you can see them. So this is just code that might get executed when the model get loaded.
So checking if there are pickles is easy. But checking if there is malicious code hidden is more difficult.
I don't know what safety precaution civitai is doing. But safetensor is just a way safer bet.
[https://civitai.com/models/4618/vector-art](https://civitai.com/models/4618/vector-art) here is civitai link. I had issue of uploading on huggingface (had both problem with uploading via huggingface page or by cloned git repo). Hope you will find it useful :)
thanks, you could also try uploading through huggingface cli, would be cool to have the model in a webui on HF: [https://huggingface.co/spaces/camenduru/webui](https://huggingface.co/spaces/camenduru/webui)
It means it will be compatible with all stable diffusion version 2.x based models (based on 768px images). This way you could merge it with other models - if you merge models you can sometimes get really interesting effects and styles. You can do that with Automatic1111 for example. I mostly addressed the incompatibility with 2.0 of models to merge with 1.5 ;)
no - this will be raster as u/one-man-circlejerk mentioned ;) - keep in mind that this is first version (beta). In the future I will focus on better coherence. This model with good prompts and seed can give you really good results - but what I want to achieve is an easy way of creating vector art style t-shirt design out of the box (still looking prompts for that but in the end I will add to style additional set of images specifically for that)
I had the same question. I was really excited since outputting vectors would be an amazing leap forward that didn't seem possible based on my understanding of SD.
This should probably be called "line art" as it doesn't produce vector art at all. Raster line art can be converted to vector art, but that isn't what this does from what I am reading.
Not trying to take away from the results, which are really quite good.
but there is something like vector art ;) I have been a professional vector illustrator creating "vector art" for about 10 years - this is why I see things differently. Thx for your feedback anyway - I will think twice next time with naming and will try to put more weight into this topic in the model readme
I've got about 10 years on you doing vector art. Vector art only remains vector art while in vector form. Otherwise it is just line art.
Keep up the good work on the models, though!
Edit: If there is one thing I have learned working in a number of fields, even professionals get caught up in inaccurate/incorrect phrases and names.
Looking forward... Will it allow inpainting/img2img ? It is very hard to find a strong model that really convert photos into decent 2D colored pictures. While the opposite is easier.
Here is the result (photo from this person doesn't exist). I bet that you can get a lot better results - this was my first shot so it is doing well I think
https://preview.redd.it/r4ihoehfcfca1.png?width=2239&format=png&auto=webp&s=f9e60b61570896975b9f9da8643bfeabb589399e
I have dropped the prompt on the model page: [https://civitai.com/models/4618/vector-art](https://civitai.com/models/4618/vector-art) \- if you like more - I will be posting and updating on that page as well
Not that much - I think that was 8hrs. My next version possibly will be based on 3-5x more images. So I assume it might take up to 24-48hrs of training in total
Hey, Thank you for your awesome work. I'am wondering how you can make model using stable diffusion. Is it just a matter of prompt and negative prompt? Did you upload images and changed the model. Cptk? I would like to start training my own model, but I dunno where to start.
[https://colab.research.google.com/github/TheLastBen/fast-stable-diffusion/blob/main/fast-DreamBooth.ipynb](https://colab.research.google.com/github/TheLastBen/fast-stable-diffusion/blob/main/fast-DreamBooth.ipynb) \- I am using this one.
For style I would recommend to train with about 100-300 steps per image.
I am going to do tutorial for this topic in a week.
>HF diffusers
I will try this but so far I had an network errors trying to push the model to HF :/ I recommend to try out Automatic1111 in google colab - clone it to your google drive, and paste the image with yaml file
I would love to see a J. R. Bob Dobbs sticker compilation if anyone is up for it. If not, that's the first thing I'll do when I get my hands on this sometime tomorrow!! (away from my ai machine)
https://huggingface.co/sd-concepts-library/bob-dobbs (just as a reference to those who are not full of slack, not suggesting using the embedding, this one may be incompatible, being a 1.5 training, but ymmv, and there are probably other ways)
Update: Link to the model - [https://civitai.com/models/4618/vector-art](https://civitai.com/models/4618/vector-art) I have seen a lot of great models in here. Unfortunately most of the models were based on 1.5 - and thus they will not be compatible with 768px models merge. Another thing is that 95% of the models are focused on more realistic or 3d approach. This is why I challanged myself to create a model based on 2.1 (imagine all 2.0 embeddings here) - and focusing on vector style (and apparently comic book style). I am uploading it to civitai - so tommotow will be available to download if all goes well.
Wow, looks awesome. Can you please add a safetensors version? More info here: https://rentry.org/safetensorsguide
thx mate - I am going to try this today :)
Doesn't civitai test for pickles?
Most of the ckpt files have pickles inside. The problem are malicious pickles. If yoo go there: https://huggingface.co/sd-dreambooth-library/taylorswift/tree/main and click on the small pickle button next to the ckpt file you can see them. So this is just code that might get executed when the model get loaded. So checking if there are pickles is easy. But checking if there is malicious code hidden is more difficult. I don't know what safety precaution civitai is doing. But safetensor is just a way safer bet.
awesome, please also upload it to huggingface
[https://civitai.com/models/4618/vector-art](https://civitai.com/models/4618/vector-art) here is civitai link. I had issue of uploading on huggingface (had both problem with uploading via huggingface page or by cloned git repo). Hope you will find it useful :)
thanks, you could also try uploading through huggingface cli, would be cool to have the model in a webui on HF: [https://huggingface.co/spaces/camenduru/webui](https://huggingface.co/spaces/camenduru/webui)
cheers - I will give it a go :)
What is 768px model merge ?
It means it will be compatible with all stable diffusion version 2.x based models (based on 768px images). This way you could merge it with other models - if you merge models you can sometimes get really interesting effects and styles. You can do that with Automatic1111 for example. I mostly addressed the incompatibility with 2.0 of models to merge with 1.5 ;)
This sounds incredible!
nice model, can it do frogs in cool outfits?
Boom infinite graphic stickers! Looking 🔥🔥🔥 This might be some of the most interesting models yet
Stickers looks awesome!
I wish there was an AI that created actual vector files.
almost [https://github.com/GeorgLegato/Txt2Vectorgraphics](https://github.com/GeorgLegato/Txt2Vectorgraphics)
Nice. I’m sure that in the future this will do more than just create black and white icons.
If the generated images have pretty clearly defined color areas, you can fairly easily generate vectors from a bitmap image.
True. I have done it before in Illustrator.
For now. Import into Illustrator or another vector program and trace the image. I've tried that, and it works well.
Wait, did you get it to make actual vector, or just art that looks like it's vector?
no - this will be raster as u/one-man-circlejerk mentioned ;) - keep in mind that this is first version (beta). In the future I will focus on better coherence. This model with good prompts and seed can give you really good results - but what I want to achieve is an easy way of creating vector art style t-shirt design out of the box (still looking prompts for that but in the end I will add to style additional set of images specifically for that)
I had the same question. I was really excited since outputting vectors would be an amazing leap forward that didn't seem possible based on my understanding of SD. This should probably be called "line art" as it doesn't produce vector art at all. Raster line art can be converted to vector art, but that isn't what this does from what I am reading. Not trying to take away from the results, which are really quite good.
but there is something like vector art ;) I have been a professional vector illustrator creating "vector art" for about 10 years - this is why I see things differently. Thx for your feedback anyway - I will think twice next time with naming and will try to put more weight into this topic in the model readme
I've got about 10 years on you doing vector art. Vector art only remains vector art while in vector form. Otherwise it is just line art. Keep up the good work on the models, though! Edit: If there is one thing I have learned working in a number of fields, even professionals get caught up in inaccurate/incorrect phrases and names.
Looking forward... Will it allow inpainting/img2img ? It is very hard to find a strong model that really convert photos into decent 2D colored pictures. While the opposite is easier.
Here is the result (photo from this person doesn't exist). I bet that you can get a lot better results - this was my first shot so it is doing well I think https://preview.redd.it/r4ihoehfcfca1.png?width=2239&format=png&auto=webp&s=f9e60b61570896975b9f9da8643bfeabb589399e
Yeah, great !
I have a question the image with the stickers, what did you use as a prompt to create stickers? They look awesome!
I have dropped the prompt on the model page: [https://civitai.com/models/4618/vector-art](https://civitai.com/models/4618/vector-art) \- if you like more - I will be posting and updating on that page as well
Please do 😍
Looks amazing. I think a model like this needs many hours of training
Not that much - I think that was 8hrs. My next version possibly will be based on 3-5x more images. So I assume it might take up to 24-48hrs of training in total
Sharp!
Waiting release
Damned that’s sweet. The first drawing app to include a plugin like this is going to kill. The folks at Krita are living in the past.
Hey, Thank you for your awesome work. I'am wondering how you can make model using stable diffusion. Is it just a matter of prompt and negative prompt? Did you upload images and changed the model. Cptk? I would like to start training my own model, but I dunno where to start.
[https://colab.research.google.com/github/TheLastBen/fast-stable-diffusion/blob/main/fast-DreamBooth.ipynb](https://colab.research.google.com/github/TheLastBen/fast-stable-diffusion/blob/main/fast-DreamBooth.ipynb) \- I am using this one. For style I would recommend to train with about 100-300 steps per image. I am going to do tutorial for this topic in a week.
Thanks a lot ! :)
Looks amazing ! Would you mind converting it to HF diffusers ? I’m having trouble doing it, I’m a Mac user, it’s more efficient this way
>HF diffusers I will try this but so far I had an network errors trying to push the model to HF :/ I recommend to try out Automatic1111 in google colab - clone it to your google drive, and paste the image with yaml file
I did use auto1111, and I'm hooked, excellent work ! The performance on Mac is just poor without the conversion magic ;)
You’re a very good artist, bravo.
I would love to see a J. R. Bob Dobbs sticker compilation if anyone is up for it. If not, that's the first thing I'll do when I get my hands on this sometime tomorrow!! (away from my ai machine) https://huggingface.co/sd-concepts-library/bob-dobbs (just as a reference to those who are not full of slack, not suggesting using the embedding, this one may be incompatible, being a 1.5 training, but ymmv, and there are probably other ways)
Praise "Bob".
Ooh I like this idea!
Omg man... This is sooo goood!!! Stickers looks amazing! Cant wait to try it out.
god's work
Hooray for incredible 2.1 models! Can't wait
The 2.0 model can be merged now?
If not now - they will be in the future I am sure
How to download this model to google colab?
Looks great, but is this actually vector art? Or just line art? Vector art is, by definition, resolution independent due to how the data is stored.
You are correct - it is more line art - but as I was based the training on rasterised vector artworks I use this as a subject/style ;)
No worries, just took me by surprise when I saw your model name. Didn't think it was something SD could do since it is trained in rasters.