SDXL lightning

Today ByteDance released SDXL Lightning (adding to the family of distilled/faster SDXL versions Turbo, LCM). From the paper, we can improvements in the quality and how close it matches SDXL.

results from paper

Exploring Parti Prompts

I recently rendered SDXL as part of parti prompts, and Lightning is quick - let’s make it easy to compare.

Below, each row is a different (initial noise) seed, whereas columns are different models (SDXL, Lightning 1 step, …)

Drag the slider (or type a number between 0 and 1632) to change the prompt. Additionally, you can click any image to see the full-size verison.

Parti Prompt Disclaimer

Many of these prompts are challenging for current generative imagery models. Compare: 253 “a motorcycle” vs 999 “a black background with a large yellow square”.

prompts = FileAttachment("PartiPrompts.tsv").tsv({array: true, typed: true})

models = [{"name": "SDXL", 'path': "sdxl", "default": true}, 
{"name": "Lightning 8 Steps", "path": "sdxl-lightning-unet-8", "default": true}, 
{"name": "Lightning 4 Steps", "path": "sdxl-lightning-unet-4"}, 
{"name": "Lightning 2 Steps", "path": "sdxl-lightning-unet-2"},
{"name": "Lightning 1 Steps", "path": "sdxl-lightning-unet-1", "default": true}, 
// {"name": "Turbo 1024px 4 Steps", "path": "sdxl-turbo-1024-4"},
// {"name": "Turbo 1024px 2 Steps", "path": "sdxl-turbo-1024-2"},
// {"name": "Turbo 1024px 1 Steps", "path": "sdxl-turbo-1024-1"},
{"name": "Turbo 512px 4 Steps", "path": "sdxl-turbo-4"},
{"name": "Turbo 512px 2 Steps", "path": "sdxl-turbo-2", "default": true},
{"name": "Turbo 512px 1 Steps", "path": "sdxl-turbo"},
];

viewof enabledModels = Inputs.checkbox(models, {label: "Models", value: models.filter(x => x.default), format: x=>x.name})

viewof prompt = Inputs.range([0, 1631], {step: 1, value: 40, label: "Prompt"})
prompts[prompt+1][0]

table = html`<table></table>`

updateTable = async (prompt, enabledModels) => {
  console.log(enabledModels)
  while (table.hasChildNodes()) {
    table.removeChild(table.firstChild)
  }
  
  let tr = document.createElement('tr')
  let th = document.createElement('th');
  th.innerText = 'Seed'
  tr.appendChild(th);
  
  for (let seed=0; seed<4; seed++) {
    th = document.createElement('th');
    th.innerText = seed
    th.style.textAlign = 'center'
    tr.appendChild(th);
  }
  table.appendChild(tr);
  
  for (let i = 0; i < enabledModels.length; i++) {
    const model = enabledModels[i].path;
    tr = document.createElement('tr')
    let th = document.createElement('th')
    th.innerText = enabledModels[i].name;
    tr.appendChild(th)
    for (let seed=0; seed<4; seed++) {
      let img = document.createElement('img');
      img.src = `https://r2.anotherjesse.com/parti/${model}/${seed}/${prompt}_t.jpg`;
      img.width = 256;
      img.height = 256;
      let a = document.createElement('a');
      a.href = `https://r2.anotherjesse.com/parti/${model}/${seed}/${prompt}.jpg`;
      a.target = '_blank';
      a.appendChild(img)
      let td = document.createElement('td');
      td.appendChild(a)
      tr.appendChild(td)
    }
    table.appendChild(tr)
  }
};

updateTable(prompt, enabledModels);