Re: lwIP UDP thoughut w/o an RTOS

Altera_Forum · ‎07-21-2005

Wanted to receive 1500 byte payload from 100 MAC (on Cyclone II) device, and using lwIP UDP no RTOS is required.

Can the UDP RX receive 80 Mbit/s? Where the UDP TX is minimal for data flow control only.

The lwIP UDP RX just stripes off the header, and pass the data directly to an DMA.

Any advise?

Altera_Forum · ‎07-22-2005

HI provintan,

I don't what speed can u reach (I haven't test it exactly yet), but I could suggest you some modifications:

- implementing rx procedure through interupt, instead with polling as is in the web server example.

- put interupt vector table in a TCM, along with interupt stack and interupt function

- i'm designing a custom peripheral for checksum calculation

- stand alone LWIP is faster (or better RX and TX speed are more balanced)

I don't if this could help u....

bye

Altera_Forum · ‎07-22-2005

Hello provintan,

Yes it is possible to receive UDP packets with over 80 MBit/s. It seems that I’m working on a similar application like you. I got about 82 MBit/s UDP Rx.

My system consists of:

1. Cyclone EP1C12 @ 50 MHz CPU clock

2. 32 MB SDRAM

3. 4 MB Flash

4. Davicom DM9000 Ethernet MAC/PHY (using the 16 bit bus)

5. some others stuff …

For the first experiments I was using “lwip” but unfortunately “lwip” is very slow in handling large udp packets because “lwip” is copying fragmented packets some times around. For getting this speed some changes were needed in my system:

1. Because “lwip” is not very fast, it is better to write your own little udp stack. In my system lwip resides belong a little udp stack. For this I’m filtering incoming udp packets directly in the MAC driver (DM9000) and store the payload in the SDRAM via DMA. “lwip” will handle ARPs and the other network data like TCP.

2. It is necessary to get the data out of the SRAM of the MAC as fast as possible. If you are too slow the SRAM will overflow! Keep attention on the timing of the Ethernet MAC when using DMA (you have to slow down the DMA with the timing settings for the MAC).

3. Unfortunately I hadn’t enough IOs (240 PQFP) so I had to connect the DM9000 via a 16 bit bus with the Cyclone. This results in a lower bandwidth. To compensate this behaviour an own bridge connects the outside tri-state bus (DM9000, Flash, CompactFlash) with the Avalon bus. The bridge controls the timing and is doing dynamic bus sizing (32 bit to 16 bit) for read and write cycles.

So you see it is possible. I hope my explanation helps you to get the desired speed out of your system.

Good luck,

niosIIuser

Altera_Forum · ‎11-07-2005

--- Quote Start ---

originally posted by niosiiuser@Jul 22 2005, 02:21 AM

hello provintan,

yes it is possible to receive udp packets with over 80 mbit/s. it seems that i’m working on a similar application like you. i got about 82 mbit/s udp rx.

my system consists of:

1. cyclone ep1c12 @ 50 mhz cpu clock

2. 32 mb sdram

3. 4 mb flash

4. davicom dm9000 ethernet mac/phy (using the 16 bit bus)

5. some others stuff …

for the first experiments i was using “lwip” but unfortunately “lwip” is very slow in handling large udp packets because “lwip” is copying fragmented packets some times around. for getting this speed some changes were needed in my system:

1. because “lwip” is not very fast, it is better to write your own little udp stack. in my system lwip resides belong a little udp stack. for this i’m filtering incoming udp packets directly in the mac driver (dm9000) and store the payload in the sdram via dma. “lwip” will handle arps and the other network data like tcp.

2. it is necessary to get the data out of the sram of the mac as fast as possible. if you are too slow the sram will overflow! keep attention on the timing of the ethernet mac when using dma (you have to slow down the dma with the timing settings for the mac).

3. unfortunately i hadn’t enough ios (240 pqfp) so i had to connect the dm9000 via a 16 bit bus with the cyclone. this results in a lower bandwidth. to compensate this behaviour an own bridge connects the outside tri-state bus (dm9000, flash, compactflash) with the avalon bus. the bridge controls the timing and is doing dynamic bus sizing (32 bit to 16 bit) for read and write cycles.

so you see it is possible. i hope my explanation helps you to get the desired speed out of your system.

good luck,

niosiiuser

<div align='right'><{post_snapback}> (index.php?act=findpost&pid=8541)

--- quote end ---

--- Quote End ---

Sounds very good 80 MBit... could you show me how you receive those packets NIOSIIUSER?! I am trying to send packets from another application, but ethereal says it couldn't open destination port

Cheers,

Danny

Altera_Forum · ‎11-07-2005

--- Quote Start ---

originally posted by dannyjacobs@Nov 7 2005, 03:48 PM

sounds very good 80 mbit... could you show me how you receive those packets niosiiuser?! i am trying to send packets from another application, but ethereal says it couldn't open destination port

cheers,

danny

--- Quote End ---

Hello Danny,

What do you mean by „could you show me how you receive those packets“? Do you mean how I measured the speed?

Regards,

niosIIuser

Altera_Forum · ‎11-08-2005

--- Quote Start ---

originally posted by niosiiuser+nov 7 2005, 11:21 am--><div class='quotetop'>quote (niosiiuser @ nov 7 2005, 11:21 am)</div>

--- quote start ---

<!--quotebegin-dannyjacobs@Nov 7 2005, 03:48 PM

sounds very good 80 mbit... could you show me how you receive those packets niosiiuser?! i am trying to send packets from another application, but ethereal says it couldn't open destination port

cheers,

danny

--- Quote End ---

Hello Danny,

What do you mean by „could you show me how you receive those packets“? Do you mean how I measured the speed?

Regards,

niosIIuser

<div align='right'><{post_snapback}> (index.php?act=findpost&pid=10825)</div>

[/b]

--- Quote End ---

Hi niosIIuser,

well I wrote a simple program to send UDP messages... That seems to work, but when I try to receive those messages it doesn't work. I tried to capture with etherreal what was going on, but for some reason the destination port is unreachable of my NIOS II dev kit. So I thought perhaps you could show me how you can receive UDP messages. I'm a newbie with NIOS II and as an interm they want me to capture data at high speed. So 80 Mbit/s is a very nice speed. That's the speed they want here. But still don't know how to receive any incoming messages.

Cheers,

Danny

Altera_Forum · ‎11-08-2005

Hello Danny,

As I wrote above I don’t use lwip for receiving UDP packets in my application. If you start with Nios etc. you should use lwip first, because it’s a working system. When you have built a stable system you can add some hardware accelerations to achieve higher bandwidth.

The following code shows a very small UDP receive routine. I used this one for testing purposes only. After you have sent 1024 packets to port 1409 there will be a message.

#include "lwip/debug.h"# include "lwip/stats.h"# include "lwip/udp.h"
u32_t udp_packets;
static void udp_test_recv(void *arg, struct udp_pcb *upcb, struct pbuf *p,
                          struct ip_addr *addr, u16_t port)
{
/*
  printf("\nUDP packet received from: %d.%d.%d.%d : %d",
          (addr->addr)&0xFF, ((addr->addr)>>8)&0xFF,
          ((addr->addr)>>16)&0xFF, (addr->addr)>>24, port);
*/
  udp_packets++;
  //printf("\nlen: %d, tot_len: %d", p->len, p->tot_len);
  if (udp_packets % 1024 == 0)
    printf("\n%d udp_packets received", udp_packets);
  pbuf_free(p);
}
/*-----------------------------------------------------------------------------------*/
void
udp_test_init(void)
{
  struct udp_pcb *pcb;
  printf("udp_init\n");
  
  udp_packets = 0;
  
  pcb = udp_new();
  udp_bind(pcb, IP_ADDR_ANY, 1409);
  udp_recv(pcb, udp_test_recv, NULL);
}
/*-----------------------------------------------------------------------------------*/

Regards,

niosIIuser

Altera_Forum · ‎11-08-2005

Hi niosIIuser,

receiving wasn't a problem. The problem is to send something out. It doesn't seem to be working. Destination and port seem to be '0' according to etherreal.

Cheers,

Danny

Altera_Forum · ‎11-08-2005

Hell Danny,

take a look at the following code. After executing "udp_test_init" it should be possible to send UDP packets.

IP4_ADDR(&udpDestIpAddr, 192, 168, 2, 150);
pbuflfsr = pbuf_alloc(PBUF_TRANSPORT,LFSR_LENGTH,PBUF_RAM);    //Get a pbuf struct.
((u8_t *)(pbuflfsr->payload)) = LFSR_TOS;
((u8_t *)(pbuflfsr->payload)) = LFSR_VS;
((u8_t *)(pbuflfsr->payload)) = 0x00;
((u8_t *)(pbuflfsr->payload)) = 0x00;
udp_sendto(pcb, pbuflfsr, &udpDestIpAddr, 1510);

Regards,

niosIIuser

Altera_Forum · ‎11-16-2005

Hi all,

what would be the maximum speed to send UDP packets? Right now I've reached 18 Mbit/s, but for some reason when I try to send a string all I receive on the PC's side is some ascii... I think sending data over 80Mbit/s should be possible or am I wrong?! I'm trying to send this:

******************************************************************

/*

*

* This file is for testing stand-alone (NO_SYS) LWIP

* using a RAM-based simple file system

*

*/

# include "system.h"

# include "arch/init.h"# include "lwip/ip_addr.h"# include "lwip/tcpip.h"# include "lwip/netif.h"# include "netif/lan91c111if.h"

# include "sys/alt_alarm.h"# define get_milliseconds() alt_nticks()

/* ---------- IP oriented addresses for ethernet adapter ---------- */# define IPADDR0 169# define IPADDR1 254# define IPADDR2 0# define IPADDR3 2

# define NETMASK0 255# define NETMASK1 255# define NETMASK2 0# define NETMASK3 0

# define GWADDR0 169# define GWADDR1 254# define GWADDR2 0# define GWADDR3 3

int main(void)

{

//0.6.4 struct netif *netif;

struct netif netif;

struct ip_addr ipaddr, netmask, gw;

struct ip_addr destIpAddr;

struct udp_pcb* pcb;

struct pbuf* p;

unsigned char buffer[100] = "beetje flauw\n";

unsigned char *buffPtr;

alt_avalon_lan91c111_if* dev_list_ptr = (alt_avalon_lan91c111_if*)alt_ethernet_device_list.next;

buffPtr = mem_malloc(sizeof(buffer));

memcpy(buffPtr, buffer, sizeof(buffer)); //copy's from buffer to buffer

/*

* Initialize lwip

*/

lwip_init();

printf ("Setting IP address to: %d.%d.%d.%d\n", IPADDR0, IPADDR1, IPADDR2, IPADDR3);

printf ("Setting netmask to: %d.%d.%d.%d\n", NETMASK0, NETMASK1, NETMASK2, NETMASK3);

printf ("Setting gateway address to: %d.%d.%d.%d\n", GWADDR0, GWADDR1, GWADDR2, GWADDR3);

IP4_ADDR(&ipaddr, IPADDR0, IPADDR1, IPADDR2, IPADDR3);

IP4_ADDR(&netmask, NETMASK0, NETMASK1, NETMASK2, NETMASK3);

IP4_ADDR(&gw, GWADDR0, GWADDR1, GWADDR2, GWADDR3);

//0.6.4 netif = netif_add(&ipaddr, &netmask, &gw,

netif_add(&netif, &ipaddr, &netmask, &gw,

(void*)dev_list_ptr,

lan91c111if_init,

ip_input);

//0.6.4 netif_set_default(&netif);

netif_set_default(&netif);

p = pbuf_alloc(PBUF_TRANSPORT,4096,PBUF_RAM);

p->payload = (void*)buffPtr;

IP4_ADDR(&destIpAddr, 169, 254, 0, 1);

pcb = udp_new();

udp_connect(pcb, &destIpAddr, 666);

//mem_free(buffPtr);

udp_remove(pcb);

while(1)

{

//0.6.4 lan91c111if_service(netif);

lan91c111if_service(&netif);

udp_send(pcb, p);

// printf(buffer);

}

******************************************************************

this is the way I am trying to send it... but it doesn't reach the pc in the right way. I even wonder if am sending this string.

Suggestions anyone?

Thanx,

Danny

Altera_Forum · ‎08-21-2006

Ok it worked http://forum.niosforum.com/work2/style_emoticons/<#EMO_DIR#>/biggrin.gif

80 MBit/s is possible http://forum.niosforum.com/work2/style_emoticons/<#EMO_DIR#>/smile.gif my coach was very pleased!!!

Thanx for all your help http://forum.niosforum.com/work2/style_emoticons/<#EMO_DIR#>/smile.gif

Cheers,

Danny

Altera_Forum · ‎09-19-2006

--- Quote Start ---

originally posted by niosiiuser@Jul 22 2005, 02:21 AM

hello provintan,

yes it is possible to receive udp packets with over 80 mbit/s. it seems that i’m working on a similar application like you. i got about 82 mbit/s udp rx.

my system consists of:

1. cyclone ep1c12 @ 50 mhz cpu clock

2. 32 mb sdram

3. 4 mb flash

4. davicom dm9000 ethernet mac/phy (using the 16 bit bus)

5. some others stuff …

for the first experiments i was using “lwip” but unfortunately “lwip” is very slow in handling large udp packets because “lwip” is copying fragmented packets some times around. for getting this speed some changes were needed in my system:

1. because “lwip” is not very fast, it is better to write your own little udp stack. in my system lwip resides belong a little udp stack. for this i’m filtering incoming udp packets directly in the mac driver (dm9000) and store the payload in the sdram via dma. “lwip” will handle arps and the other network data like tcp.

2. it is necessary to get the data out of the sram of the mac as fast as possible. if you are too slow the sram will overflow! keep attention on the timing of the ethernet mac when using dma (you have to slow down the dma with the timing settings for the mac).

3. unfortunately i hadn’t enough ios (240 pqfp) so i had to connect the dm9000 via a 16 bit bus with the cyclone. this results in a lower bandwidth. to compensate this behaviour an own bridge connects the outside tri-state bus (dm9000, flash, compactflash) with the avalon bus. the bridge controls the timing and is doing dynamic bus sizing (32 bit to 16 bit) for read and write cycles.

so you see it is possible. i hope my explanation helps you to get the desired speed out of your system.

good luck,

niosiiuser

<div align='right'><{post_snapback}> (index.php?act=findpost&pid=8541)

--- quote end ---

--- Quote End ---

hi:

i am very interesting your word.I think you are right ,the lwip is slow .recent i use dma to speed the transfer.but i test the sram to lan91 is ok.but when i degug the altera_avalon_lan91c111.c,it cant work.I think the niosII ide have some bug!!

i want to know how to solve this problem!!can i see you code of your changed lwip!!

thank you!!

the code is :

int alt_avalon_lan91c111_output(alt_avalon_lan91c111_if *dev, void *buffer, alt_u32 length)

{

alt_u8 irq_value;

alt_u16 mmu_status;

alt_u32 remainder;

alt_u32 len = length;

alt_u8 buffer1[200];

void *buf =(void *) buffer;

void *test;

alt_dma_txchan txchan;

int tx,i,k;

buffer1[0]=0x10;

buffer1[1]=0x11;

buffer1[2]=0x12;

buffer1[3]=0x13;

buffer1[4]=0x14;

buffer1[5]=0x15;

IOWR_32DIRECT(0x1055248, 0, 0x87654321);

/* Wait for the last Tx to complete */

do

{

irq_value = IORD_ALTERA_AVALON_LAN91C111_IST(dev->base_addr);

}while(!(irq_value & ALTERA_AVALON_LAN91C111_INT_TX_EMPTY_INT_MSK));

/* Clear the interrupt */

IOWR_ALTERA_AVALON_LAN91C111_ACK( dev->base_addr,

ALTERA_AVALON_LAN91C111_INT_TX_EMPTY_INT_MSK);

/* Always re-use the same packet */

IOWR_ALTERA_AVALON_LAN91C111_PNR( dev->base_addr,

dev->tx_packet_no);

IOWR_ALTERA_AVALON_LAN91C111_PTR( dev->base_addr,

ALTERA_AVALON_LAN91C111_PTR_AUTO_INCR_MSK);

/* The status word */

IOWR_ALTERA_AVALON_LAN91C111_DATA_HW( dev->base_addr, 0);

/*

* The byte count including the 6 control bytes

*

* Bit odd this, but the length is always written as even, if the frame is an odd length

* then the byte is written as one of the control words and an appropriate bit is set

*

*/

IOWR_ALTERA_AVALON_LAN91C111_DATA_HW( dev->base_addr, ((length & ~1) + 6));

/*

* Write buffer of data to the device

*

* Nios requires accesses to be aligned on the correct boundary

*

*/

while ((int)buf & 3)

{

IOWR_ALTERA_AVALON_LAN91C111_DATA_BYTE( dev->base_addr, *((alt_u8*)buf)++);

len--;

}

remainder = len & 3;

/* Write out the 32 bit values */

len>>=2;

if (len < 186){

while (len & ~7) /* Write 8-tuples of 32 bit values */

{

IOWR_ALTERA_AVALON_LAN91C111_DATA_WORD( dev->base_addr, *((alt_u32*)buf)++);

len-=8;

}

while (len)

{

IOWR_ALTERA_AVALON_LAN91C111_DATA_WORD( dev->base_addr, *((alt_u32*)buf)++);

len--;

}

}else{

test = buf;

for(i=0; i<= 200; i+=1)

{

printf("00:%x,%x\n",((alt_u32*)test)+i,*((alt_u32*)test+i));

}

if ((txchan = alt_dma_txchan_open("/dev/dma")) == NULL)

{

exit (1);

}

//printf ("0: %d,%d,%d\n",remainder,(alt_u8*)buf,*(alt_u8*)buf);

printf ("0: %d,%d,%d\n",len*4,(alt_u8*)buf,*(alt_u8*)buf);

alt_dma_rxchan_ioctl (txchan,0x3, dev->base_addr+8);

alt_dma_rxchan_ioctl (txchan,0x7, dev->base_addr+8);

if ((tx = alt_dma_txchan_send (txchan,buf,len*4,dma_tx,NULL)) < 0)

{

printf ("1: %d\n", tx);

exit(1);

}

while (!tx_done);

//printf ("2: %d\n", tx);

(alt_u8*)buf=(alt_u8*)buf+len*4;

IOWR_ALTERA_AVALON_LAN91C111_PTR( dev->base_addr,0x6000);

for(i=0; i<= 800; i+=4)

{

k = IORD_32DIRECT(dev->base_addr,8);

printf("%x\n",k);

}

//printf ("2: %d,%d,%d\n",remainder,(alt_u8*)buf,*(alt_u8*)buf);

printf ("2: %d,%d,%d\n",len*4,(alt_u8*)buf,*(alt_u8*)buf);

alt_dma_txchan_close (txchan);

len = 0;

tx_done = 0;

}

while (remainder)

{

IOWR_ALTERA_AVALON_LAN91C111_DATA_BYTE( dev->base_addr, *((alt_u8*)buf)++);

remainder--;

}

if (length & 1)

{

IOWR_ALTERA_AVALON_LAN91C111_DATA_BYTE( dev->base_addr,

ALTERA_AVALON_LAN91C111_CONTROL_ODD_MSK);

}

else

{

IOWR_ALTERA_AVALON_LAN91C111_DATA_HW( dev->base_addr, 0);

}

/*

* Accesses to the MMUCR have to be protected with a semaphore as it's possible

* that we could wait for this register not to be busy and in between our read

* and the write an interrupt could occur which causes the scheduler to run and

* the ethernet_rx thread could be run!

*/

# if 0

ALT_SEM_PEND(dev->semaphore, 1);# endif

/* Wait for any pending commands to complete */

do

{

mmu_status = IORD_ALTERA_AVALON_LAN91C111_MMUCR(dev->base_addr);

}while (mmu_status & ALTERA_AVALON_LAN91C111_MMUCR_BUSY_MSK);

/* Queue the packet */

IOWR_ALTERA_AVALON_LAN91C111_MMUCR( dev->base_addr,

ALTERA_AVALON_LAN91C111_MMUCR_ENQUEUE_MSK);# if 0

ALT_SEM_POST(dev->semaphore);# endif

return 0;

}

Altera_Forum · ‎09-19-2006

Hi @ all,

well it seems that I've lost my code, but it is not that hard to accomplish it. What I did mostly (because it was possible) is to clock the NIOS @ 135 MHz, use max datacache and instructioncache. Furthermore I used the UDP-feature of the lwip-stack.

Good luck.

Cheers,

Danny

Altera_Forum · ‎09-24-2006

--- Quote Start ---

originally posted by niosiiuser@Jul 22 2005, 02:21 AM

hello provintan,

yes it is possible to receive udp packets with over 80 mbit/s. it seems that i’m working on a similar application like you. i got about 82 mbit/s udp rx.

my system consists of:

1. cyclone ep1c12 @ 50 mhz cpu clock

2. 32 mb sdram

3. 4 mb flash

4. davicom dm9000 ethernet mac/phy (using the 16 bit bus)

5. some others stuff …

for the first experiments i was using “lwip” but unfortunately “lwip” is very slow in handling large udp packets because “lwip” is copying fragmented packets some times around. for getting this speed some changes were needed in my system:

1. because “lwip” is not very fast, it is better to write your own little udp stack. in my system lwip resides belong a little udp stack. for this i’m filtering incoming udp packets directly in the mac driver (dm9000) and store the payload in the sdram via dma. “lwip” will handle arps and the other network data like tcp.

2. it is necessary to get the data out of the sram of the mac as fast as possible. if you are too slow the sram will overflow! keep attention on the timing of the ethernet mac when using dma (you have to slow down the dma with the timing settings for the mac).

3. unfortunately i hadn’t enough ios (240 pqfp) so i had to connect the dm9000 via a 16 bit bus with the cyclone. this results in a lower bandwidth. to compensate this behaviour an own bridge connects the outside tri-state bus (dm9000, flash, compactflash) with the avalon bus. the bridge controls the timing and is doing dynamic bus sizing (32 bit to 16 bit) for read and write cycles.

so you see it is possible. i hope my explanation helps you to get the desired speed out of your system.

good luck,

niosiiuser

<div align='right'><{post_snapback}> (index.php?act=findpost&pid=8541)

--- quote end ---

--- Quote End ---

hello niosiiuser:

i am very interesting what you said.i want to how you write your own little udp stack and tcp stack?hope to receive your letter and your code!

thank for you help!!

Altera_Forum · ‎09-24-2006

--- Quote Start ---

originally posted by wwycoolboy@Sep 24 2006, 06:37 AM

hello niosiiuser:

i am very interesting what you said.i want to how you write your own little udp stack and tcp stack?hope to receive your letter and your code!

thank for you help!!

--- Quote End ---

Hello wwycoolboy,

The only thing I did was to write a little UDP stack which runs besides lwip. Lwip is managing arp and tcp. My code handles the incoming UDP packets only. Decoding UDP packets is easy. Take a look at http://en.wikipedia.org/wiki/user_datagram_protocol (http://en.wikipedia.org/wiki/user_datagram_protocol) to get more information about UDP. My code won’t help you because it is adapted to my very special needs.

If I were you I would do the following things:

1. Set up a small lwip Nios application which handles arp and udp.

2. Write a small PC application which sends UDP packets to your Nios system.

3. Examine the packets with Ethereal and compare the information with the UDP protocol to learn more about UDP.

4. Modify your Nios Ethernet driver for intercepting the UDP packets which will be received.

5. Analyse the incepted UDP packets for your application.

Good luck,

niosIIuser